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ABSTRACT 


Several  models  have  been  proposed  to  predict  the  miniminn  resolvable  temperature 
difference  (MRTD)  performance  of  second  generation  thermal  imaging  systems  (TIS)  which 
incorporate  staring  focal  plane  arrays.  It  has  been  suggested  that  these  models  are  not  accurate  for 
predicting  the  performance  of  second  generation  staring  focal  plane  arrays  which  have  severe 
phasing  or  sampling  characteristics  not  amenable  to  linear  modulation  transfer  fimction  analysis. 
A  second  problem  with  these  models  is  that  they  require  a  particular  set  of  assumptions  concerning 
the  observer  eye/brain  recognition  process,  which  limits  their  usefulness  in  the  prediction  of  the 
performance  for  systems  that  incorporate  automatic  target  recognition  (ATR)  devices.  In  this 
thesis,  a  new  model  is  presented  for  predicting  the  MRTD  performance  of  second  generation 
thermal  imagers  based  on  a  minimum  threshold  input  contrast,  and  a  contrast  reduction  factor  due 
to  aliasing  and  blurring  effects.  The  model  makes  no  assumptimis  regarding  the  recognition 
process,  which  allows  a  separate  threshold  value  to  be  defined  fw  either  a  human  or  marhinf^ 
observer.  The  model  incoqmrates  aliasing  concepts,  and  extends  pafcxmance  prediction  beyond 
the  nominal  Nyquist  rate  of  the  system.The  model’s  predictions  are  compared  to  the  predictions  of 
the  current  standard  FLJR92  model  and  measured  laboratory  results  for  two  different  staring  focal 
plane  array  imagers.  In  boA  cases,  the  model’s  predictions  match  measured  results  more  closely 
than  the  predictions  of  FLIR92. 
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0(fx,fy) . Fourier  transform  of  o(x,y) 

OTF . (^tical  transfer  function 

p(x,y) . sampling  function 

P . device  vibration  variation  factor 

. spectral  power  received 

PC . pCTSonal  computer  (IBM  compatible) 

PSF . point  spread  function 

PTF . phase  transfer  function 

PtSi . Platinum  Silicide 

q . monitor  factor 

Q . Ratches  term 

R . observer  to  TIS  distance 
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R;^_ . detector  responsivity 

Rz . FLIR92  spatial  sampling  rate  (samples/mrad) 

s(x,y) . target  scene  input  function 

S . global  data  set  average 

SNR . signal  to  noise  ratio 

SNRjjy. . threshold  signal  to  noise  ratio  for  resolution 

SPM . static  performance  model 

t . temporal  direction  subscript 

tg . eye  integration  time  (sec) 

tj . detector  integration  time  (sec) 

T . temperature  (K) 

Tp(f) . reconstructed  output  peak  contrast  in  VISMODII  (C) 

Tt(f) . reconstructed  ou^jut  trough  contrast  in  VISMODII  (C) 

TIS . thermal  imaging  system 

U . global  data  set  magnitude 

V  . vertical  direction  subscript 

V  . scan  velocity 

Vn . noise  voltage  (V) 

Vj . signal  voltage  (V) 

VISMODII  . .  second  generation  visibility  model 

W . width  of  one  bar  (cm) 

W;^^ . target  spectral  radiance  per  steradian 

X . horizontal  direction 

y . vertical  direction 

z . horizontal  or  vertical  as  ^propriate  subscript 

Z . instantaneous  field  of  view  in  horizontal  and  vertical  direction 
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I.  INTRODUCTION 


A.  REVIEW  OF  LITERATURE 

The  modeling  of  thermal  imaging  systems  (TIS)  in  order  to  predict  system 
performance  has  been  of  wide-spread  interest  since  the  1970’s.  The  figure  of  merit 
adopted  by  the  early  researchers  in  the  field  was  the  miniminn  resolvable  temperature 
difference  (MRTD).  The  earliest  of  predictive  models  followed  a  linear  optical  transfer 
function  (OTF)  analysis,  and  included  standard  probability  theory  in  order  to  predict  an 
output  signal  to  noise  ratio  given  TIS  parameters  [Refs.  1  through  7].  The  early  standard 
model  was  the  U.S.  Army  Night  Vision  Laboratory  (NVL)  model,  introduced  in  1975.  As 
the  state  of  the  art  in  TIS  systems  developed,  shortcomings  in  the  MRTD  analysis  were 
realized  and  explored,  and  alternative  models  were  presented  [Refs.  8  through  1 1]. 

Recently,  the  advent  of  widespread  use  of  staring  focal  plane  array  (FPA) 
technology  in  TIS  has  required  the  predictive  models  to  be  revised  yet  again  The  changes, 
and  corresponding  research  efforts  can  be  divided  into  several  categtnies,  inHnHing 
directional  noise,  aliasing,  sample  scene  phasing  and  others.  Directional  noise  ninHf>ling 
methods  have  been  introduced  to  account  for  fixed  pattern  noise  effects  found  in  staring 
FPA  device  ouqjuts  [Refs.  12  through  15].  The  U.S.  Army  Night  Vision  and  Electronic 
Sensors  Directorate  (NVESD)  released  a  new  model  called  FLIR92  in  1992  that  arr^nnf^H 
for  these  directional  noise  effects  [Ref.  16]. 

Unfortunately,  the  FLIR92  model  did  not  address  several  outstanding  second 
generation  modeling  concerns.  Chief  among  these  is  the  problem  of  aliasing  caused  by 
undersampling  in  the  FPA  [Refs.  17  through  25].  Other  effects  include  nnniinpnr 
electronic  processing,  sample  scene  phasing,  and  image  reconstruction  effects;  and  the 
widespread  incorporation  of  automatic  target  recognition  (ATR)  systems  [Refe.  26  through 
33].  Another  consideration  of  TIS  modeling  is  the  proper  treatment  of  the  eye/brain 
recognition  process,  and  the  understanding  of  how  the  eye  acts  as  an  optical  filter  [Refs.  34 
through  37] .  These  effects,  among  others,  must  be  included  in  any  complete  predictive 
model. 
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B.  OVERVIEW  OF  THESIS 


This  thesis  has  foxor  main  purposes.  First,  it  is  designed  to  serve  as  a  stand-alone 
document  describing  the  background  of  thermal  imaging  system  (TTS)  modeling 
development.  Second,  it  includes  a  review  and  discussion  of  second  generation  modeling 
considerations  and  touches  on  the  state  of  the  art  in  TTS  modeling.  Third,  and  most 
importantly,  the  second  generation  modeling  considerations  explored  are  incorporated  into 
an  analytical  model  for  the  prediction  of  performance  for  staring  focal  plane  array  (FPA) 
thermal  imagers.  Finally,  the  thesis  presents  test  data  obtained  in  the  laboratory  and 
evaluates  the  performance  of  the  predictive  MRTD  models. 

Chapter  I  is  an  introduction  to  the  thermal  imaging  process  with  a  brief  discussion 
of  system  parameters,  modeling  conventions,  and  associated  concepts. 

Chapter  n  provides  historical  context  for  second  generation  models  by  presenting 
established  tirst  generation  models  and  concepts. 

Chapter  HI  discusses  many  of  the  concepts  and  issues  of  second  generation  TTS 
modeling,  and  methods  of  incorporating  them  into  analytical  models,  using  FLIR92  as  an 
example. 

Chapter  IV  is  a  desaiption  of  the  laboratory  experiments  conducted  and  the  results 
obtained. 

Chapter  V  desaibes  the  development  of  a  second  generation  visibility  model  for 
TTS  performance  prediction,  VISMODH. 

Chapter  VI  is  a  comparative  analysis  of  modeled  and  experimental  results, 
including  conclusions  and  directions  for  further  research. 

Various  appendices  are  also  included  that  contain  derivations,  specifications,  or 
data  too  lengthy  or  inconvenient  to  be  included  in  the  main  manuscript. 
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C.  THE  THERMAL  IMAGING  PROCESS 


Thermal  imaging  systems  allow  the  utilization  of  middle  and  far  infrared 
wavelength  radiation  for  target  detection  and  recognition.  These  systems,  unlike  visual  or 
near  infrared  image  intensification  technologies,  exploit  the  radiance  of  objects  in  the  field 
of  view;  i.e.,  they  do  not  require  ambient  reflected  radiation.  The  spectral  radiant  emittance 
of  an  object  in  the  field  of  view  is  given  by  Planck’s  blackbody  radiation  law,  modified  by 
the  object’s  material  properties.  The  wavelength  of  greatest  radiant  emittance  in  the 
object’s  radiative  pattern  is  given  by  Wien’s  displacement  law.  The  total  radiance  and  peak 
wavelength  of  a  target’s  radiative  pattern  are  fundamentally  determined  by  its  temperature, 
modified  by  its  physical  characteristics  (emissivity  and  reflectivity),  and  affected  by  the 
ambient  radiance.  The  modified  or  ’apparent’  temperature  is  often  referred  to  as  the 
‘radiation’  temperature.  For  objects  with  radiation  temperatures  near  300K,  the  peak 
radiative  wavelength  occurs  near  10  llm,  well  above  visible  wavelengths.  The  ability  of  a 
US  to  display  a  visible  image  from  this  invisible  and  temperature-dependent  radiation 
gives  rise  to  the  term  ‘thermal  imager’. 

A  TIS  can  resolve  a  scene  based  on  the  radiation  temperature  differences  among 
the  objects  in  a  scene,  provided  the  electronic  signal  generated  by  the  radiation  detection 
process  is  large  enough  to  overcome  noise  artifacts  inherent  in  the  TIS’s  several  sub¬ 


systems.  The  thermal  imaging  process  is  best  illustrated  as  a  continuous  sequence  of  events 
as  portrayed  in  Fig.  1.1. 


Figure  1.1.  The  thermal  imaging  process 
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The  thermal  imaging  sequence  begins  with  a  scene,  delimited  by  the  projected  field 
of  view  of  the  TIS  detector  element(s).  The  scene  generally  consists  of  a  radiating  target 
as  well  as  the  target’s  radiative  environment.  Due  to  radiation  temperature  differences 
between  the  target  and  this  environment,  the  spectral  radiance  characteristics  of  each  will 
differ.  Notably,  the  target/background  scene  also  contains  reflections  from  other  radiation 
sources  in  the  wavelength  band  of  interest.  Most  TIS  are  designed  to  operate  in  the  3-5 
|im  or  8-14  jjm  wavelength  bands.  These  wavelength  bands  are  near  enough  to  the  peak 
radiance  of  objects  at  300  K  (about  10  |lm)  to  receive  a  signifreant  portion  of  a  target’s 
radiation,  and  correspond  to  atmospheric  transmission  windows. 

The  radiation  from  the  targe^ackground  scene  passes  through  an  intervening 
atmosphere  to  reach  the  TIS.  The  atmosphere  has  its  own  wavelength  dependent  scattering 
and  absorption  effects  that  are  manifest  on  both  the  target  and  backgroimd  radiation.  For 
target  detection  and  resolution  applications  in  the  field,  this  effect  can  be  very  significant. 
For  resolvability  tests  conducted  in  a  controlled  laboratory  environment,  this  effect  is  often 
considered  to  be  identical  on  both  the  target  and  background  radiation,  and  is  often  ignored. 

Next,  the  scene  radiation,  modified  by  the  atmosphere,  reaches  the  TIS  itself.  The 
radiation  is  gathered  and  focused  by  a  series  of  collecting  optics  and  optical  processing 
elements  engineered  to  be  transparent  to  the  wavelength  band  of  interest.  In  the  focal  plane 
of  the  processing  optics  is  the  detector  element(s).  Although  the  variety  of  detector  element 
materials  and  configurations  gives  rise  to  a  great  number  of  TIS  types,  the  function  of  the 
individual  detector  in  each  type  is  the  same.  This  quantum  device  detects  incoming 
photons  of  a  specific  band  of  wavelengths  by  converting  the  received  photon  energy  into 
an  electrical  signal  that  is  proportional  to  the  photon  flux  received  from  a  scene  element. 
The  wavelength  band  is  determined  by  the  energy  band  configuration  of  the  semiconductor 
material  from  which  the  detector  is  made.  The  electrical  signal  from  the  detector(s)  is  then 
processed  by  the  electrical  system  components.  This  processing  typically  includes 
temporal  filtering,  signal  boosting,  and  AC-coupling  to  subtract  common  background 
signal  levels.  The  ouq^ut  of  the  electrical  processing  sequence  is,  generally,  a  monochrome 
RS-170  analog  video  signal  which  is  displayed  by  a  standard  television  monitor.  In  some 
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cases,  the  output  is  a  digital  signal  displayed  on  a  computer  monitor,  often  in  pseudo-color. 
For  most  current  systems,  the  human  operator  then  processes  the  displayed  image  by  his  or 
her  own  visual  and  cognitive  systems.  In  this  case,  the  psycho-physical  imaging  process 
becomes  an  important  part  of  system  performance  modeling.  For  many  modem  systems, 
however,  an  automatic  target  recognition  (ATR)  device  takes  the  place  of  a  human 
observer.  A  modem  predictive  performance  model  should  also  be  able  to  incorporate  these 
objective  measurement  devices. 

D.  SYSTEM  PARAMETERS  AND  RESOLUTION 

The  great  variety  of  detector  types  and  configurations  make  it  difficult  to  discuss 
thermal  imaging  modeling  with  any  degree  of  generality.  There  are,  however,  two  general 
categories  used  to  describe  classes  of  systems  based  on  detector  configmation.  Those  ITS 
labeled  ‘first  generation’  include  those  with  a  single  detector  or  a  one-dimensional  array  of 
detector  elements.  These  systems  have  a  scanning  mechanism  consisting  of  a  set  of 
rotating  prisms  or  mirrors  that  sweeps  the  image  over  the  detector(s).  The  speed  and 
direction  in  which  the  scene  is  swept  over  the  detector(s)  defines  the  scene  dissection  into 
discrete  elements,  as  well  as  the  dwell  time  for  which  a  given  scene  element  will  be  focused 
on  a  detector.  A  second  category  of  system  uses  a  two-dimensional  array  of  detectors  that 
‘stare’  at  the  scene  with  outputs  clocked  out  at  given  intervals.  No  scanning  mechanism  is 
required  for  these  ‘second  generation’  systems,  but  their  electronic  complexity  is 
correspondingly  greater.  The  dwell  time  and  scene  dissection  of  staring  type  systems  are 
determined  by  the  detector  element  size  and  spacing,  and  the  rate  at  which  the  ouqjuts  are 
clocked  out.  It  should  be  noted  that  because  focal  plane  array  technology  has  not 
progressed  as  rapidly  as  expected,  some  systems  exist  that  combine  scanning  with  a  smaller 
two  dimensional  array.  These  hybrid  systems  are  also  often  referred  to  as  ‘second 
generation.’  For  the  purposes  of  this  thesis,  ‘second  generation’  refers  to  staring  focal 
plane  arrays;  although  many  of  the  modeling  topics  treated  here  apply  equally  well  to 
hybrid  systems. 
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The  ‘first  generation’  of  TIS  is  made  up  of  many  types  of  systems  that  share  a 
common  set  of  basic  elements.  Most  of  these  basic  elements  are  described  in  two  early 
works  in  the  field;  the  Night  Vision  Laboratory  (NVL)  Static  Performance  Model  [Ref.  1], 
and  a  1979  Navy  Research  Laboratory  technical  report  describing  the  fundamentals  of 
thermal  imaging  systems  [Ref.  2].  Thermal  imaging  basics  are  also  presented  in  an  early 
text  by  J.M.  Lloyd  on  the  subject  of  thermal  imaging  systems  [Ref.  3].  These  early  works 
and  the  basic  system  definitions  they  contain,  are  representative  of  the  standard 
fundamentals  that  have  been  adopted  by  the  thermal  imaging  community.  Current  research 
in  ‘second  generation’  modeling  is  based  heavily  on  first  generation  principles,  so  these 
fundamentals  are  of  continued  relevance. 


1.  System  Parameters  and  Definitions 


Obviously,  the  image  resulting  from  the  entire  thermal  imaging  process  depends 
heavily  on  the  parameters  of  the  TIS  system  used.  Of  particular  relevance  to  most  TIS 
^plications  is  the  discrimination  of  a  target  signal  against  backgroimd  clutter  and  system 
noise.  From  early  research  in  television  and  motion  picture  standards,  the  task  of 
discriminating  an  object  from  its  background  has  been  shown  to  depend  on  the  signal  to 
noise  ratio  (SNR)  of  the  ou^ut  of  the  system  [Ref.  2,  Chapter  IV] .  Since  noise  is  inteiposed 
at  every  event  in  the  thermal  imaging  sequence,  the  processing  artifacts  of  each  sub-system 
on  both  the  target  and  noise  signals  are  important.  The  radiation  temperature  difference 
between  the  target  and  the  background  required  for  detection  or  resolution  by  the  TIS  is 
dictated  by  the  combination  of  these  processing  artifacts. 

One  asp>ect  of  the  resolvability  of  a  target  is  the  ‘thermal  resolution’  of  the  system. 
This  parameter  is  determined  by  the  material  properties  of  the  detector  element(s).  The 
spectral  responsivity  of  a  detector,  R(X),  is  a  measure  of  the  output  electrical  signal  level 
(in  either  volts  or  amp>eres)  per  watt  of  input  radiative  power: 


R(X)  = 


Vs 


Volts  ^ 
.Watt  [imj 


(1.1) 
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where  Vj  is  the  signal  voltage  output,  is  the  incident  spectral  radiance,  and  is  the 
detector  area  [Ref.  3,  Chapter  1].  A  more  useful  detector  parameter  is  the  specific 
detectivity,  D*  (“Dee  star”)-  The  D*  parameter  is  normalized  to  a  unit  detector  area  and  a 
unit  electrical  bandwidth  to  give  the  electrical  signal  to  rms  noise  ratio  at  the  detector 
output.  D*  is  given  by: 


D*(A„f) 


R(X)7a^ 

V„ 


(1.2) 


where  Af^  is  the  detector  noise  measurement  bandwidth,  and  Vq  is  the  noise  voltage  output 


[Ref.  3,  Cht^ter  1].  The  electrical  signal  produced  by  both  the  target  and  the  background 
radiation  is  generally  large.  Unfortunately,  the  important  variation  between  the  target 
signal  and  background  levels  is  often  orders  of  magnitude  smaller.  Since  most  TIS 
applications  are  concerned  with  resolvabUity,  the  contrast  between  signal  and  noise 
voltages  is  often  enhanced  by  AC  coupling  the  signals  to  remove  the  common  DC 
component,  thereby  enhancing  the  thermal  resolution. 

In  addition  to  the  thermal  resolution,  the  ‘spatial  resolution’  is  another  important 
aspect  of  resolvability.  This  parameter  is  predominantly  established  by  the  angular  field  of 
view  of  the  TIS  as  determined  by  the  system  optics,  the  detector  response  time,  and  the 
scanning  frame  rate.  In  second  generation  systems,  the  detectix*  size  and  spacing,  and  the 
clock  rate  are  significant  in  this  regard.  In  some  cases,  it  is  limited  by  the  pixel  resolution 
of  the  display  monitor.  The  field  of  view  of  the  detector  is  the  total  background  area 
subtended  by  the  projection  of  the  detector  limits  (mto  the  target  plane.  The  systmn 
parameters  will  determine  how  finely  the  scene  is  discretized,  givra  tiiat  the  entire  scene 
must  be  scanned  within  one  scanning  period,  or  frame.  The  minimum  spatial  resolution  is 
also  influenced  by  the  distance  to  the  target  and  (^tical  iq>erture  size. 


7 


2.  Linear  Systems  Theory  Applied  to  TIS 


The  TIS  response  to  various  input  signals  can  be  described  as  a  convolutionary 
process  in  either  the  temporal  or  spatial  domain.  This  allows  the  application  of  linear 
systems  theory  to  the  problem  of  modeling  a  TIS,  and  predicting  its  thermal  and  spatial 
resolution  capabilities.  Linear  system  theory  allows  the  prediction  of  the  system’s  output 
as  the  sum  of  the  system’s  total  response  acting  on  each  point  of  the  system  input.  This 
response  is  characterized  by  and  commonly  referred  to  as  the  ‘impulse  response’  in 
electronics,  or  the  ‘point  spread  function ’(PSF)  in  optics.  These  refer  to  the  temporal  or 
spatial  domain  spreading  of  a  point  source,  or  delta  function,  input  to  a  sub-system.  The 
Fourier  transform  of  this  response  is  defined  to  be  the  ‘transfer  function’  of  the  sub-system. 
The  assumptions  made  to  accommodate  the  qjpUcation  of  linear  systems  theory  to  US 
modeling  are  significant.  In  addition  to  the  noncoherent  detection  of  radiation,  they  include 
the  linearity  of  signal  processing,  the  uniformity  of  detector  response,  and  the  spatial 
invariance  of  the  imaging  process.  Unfortimately,  these  conditions  are  routinely  violated 
to  some  degree  in  practical  TES,  posing  great  challenges  to  the  system  modeler.  Of 
necessity,  TIS  are  treated  as  linear  over  a  restricted  operating  region  to  make  mathematical 
analysis  possible  [Ref.  4].  A  special  caveat  is  in  order  here,  as  an  analytical  model  is  only 
as  good  as  the  assumptions  made  to  develop  it.  It  is  inappropriate  to  blindly  ^ply  a  model 
to  a  situation  or  application  that  does  not  fall  strictly  into  the  governing  assumption  set 
[Ref.  5].  This  problem  becomes  quite  clear  in  the  application  of  linear  models  to  sampled 
imaging  systems  as  in  Chapter  m. 

One  mathematical  tool  of  particular  usefulness  to  the  TIS  modeler  is  the  qjplication 
of  Fourier  transform  theory  to  the  assumed  convolutionary  processes  defined  by  the  sub¬ 
systems.  In  the  convolutionary  process,  the  value  of  the  ouq>ut  image  distribution,  i(x,y), 
is  found  by  summing  the  contributions  of  the  system  point  spread  function,  PSF(x,y), 
operating  on  each  point  of  the  incident  object  function  o(x,y); 

oo 

i(x,  y)  =  J  J  't2)PSF(x  -  y  -  T2)dTidT2  .  (1.3) 
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This  is  recognized  as  the  two  dimensional  convolution  of  die  object  function  with  the 
system  point  spread  function: 

i(x,  y)  =  o(x,  y)  ®  PSF(x,  y)  .  (1.4) 

The  Fourier  transform  of  the  object  function  is  defined  as: 

00 

0(f^,fy)=  3{o(x,y)}=  J  J  o(x,y)e  dy  .  (1.5) 

^oo 

Fourier  analysis  of  the  system  allows  the  desaiption  of  this  series  of  convolutions  as  the 
cascade  of  a  series  of  sub-system  transfer  functions  operating  on  the  spatial  frequency  and 
temporal  frequency  characteristics  of  the  processed  image  (the  Fourio*  transform  operate 
will  be  given  by  the  script  F  as  in  Eq.  1 .5).  The  Fourier  transfram  of  the  image  distribution 
is  given  by  the  product  of  the  Fourier  transform  of  the  object  distribution  and  the  Fourier 
transform  of  the  system  PSF.  This  last  term  is  defined  to  be  the  optical  transfer  function 
(OTF)  or  system  transfer  function. 

3{i(x,y)}  =  3{o(x,y)}  3{PSF(x.y)}.  (1.6) 

and  the  image  distribution  at  the  output  is  found  as: 

i(x.y)  =  3“^{I(f*,fy)}.  (1.7) 

Working  with  sub-system  transfer  functions  is  much  simpler  than  evaluating  multiple 
convolution  integrals.  Because  basic  system  parameters  define  the  system  transfer 
function,  the  complete  system  response  and  overall  noise  levels  are  determined  by  the 
filtering  properties  of  the  optical,  detector,  electrical,  and  di^lay  sub-systems.  For 
modeling  efficiency,  individual  system  parameters  are  often  assigned  to  one  of  these  four 
sub-systems,  each  having  its  own  sub-system  transfer  function. 

E.  MODULATION  TRANSFER  FUNCTION 

The  system  transfer  function  is  determined  by  the  cascade  of  the  sub-system 
transfer  functions.  While  working  in  the  frequency  domain,  the  sub-system  transfer 
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functions  can  be  multiplied  together  to  produce  a  TIS  ‘system’  optical  transfer  function 
(OTF).  An  OTF,  by  defmition,  is  a  complex  quantity,  having  both  magnitude  and  phase 
components.  Since  thermal  imaging  systems  are  non-coherent  detection  instruments,  the 
phase  information  is  typically  not  preserved.  Phase  information  can  become  critical  for 
defocused  situations  (e.g.,  an  array  with  some  elements  out  of  focus).  The  electronic 
processing  characteristics  of  the  device  may  also  include  phase  artifacts.  The  OTF  is  often 
treated  as  a  magnitude  transfer  function  only,  referred  to  as  the  Modulation  Transfer 
Function  (MTF).  In  such  analysis,  a  separate  phase  transfer  function  (PTF)  can  be  included 
as  necessary.  The  benefit  in  having  a  system-specific  MTF  is  that  it  allows  for  analytical 
simulation  and  performance  prediction  for  a  given  system  under  various  target  scene 
conditions.  The  performance  of  the  system  can  be  predicted  by  the  action  of  the  MTF  on 
the  spatial  fi’equency  composition  of  the  input.  Of  course,  the  effects  of  the  PTF  must  also 
be  considered  if  they  are  significant.  The  cascade  of  sub-system  transfer  functions  typicai 
to  most  first  generation  models  is  shown  in  Fig.  1.2  [Ref.  3]. 


Figure  1.2.  Cascade  of  sub-system  transfer  functions 


To  obtain  this  system  MTF,  it  is  necessary  to  first  derive  the  individual  sub-system 
transfer  functions.  The  use  of  both  spatial  and  temporal  firequencies  in  the  derivation  is 
often  confusing,  as  the  electronic  transfer  function  is  usually  given  in  Hz  and  the  others  are 
given  in  spatial  frequencies  of  cy/mrad.  The  problem  is  usually  circumvented  by 
converting  the  electronic  temporal  frequency  terms  to  the  corresponding  spatial 
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frequency.  In  first  generation  scanning  systems,  in  the  direction  of  scan,  this  simple 
conversion  is  given  by: 

fx  =  (1-8) 

where,  is  the  spatial  frequency,  f  ^  is  the  temporal  or  electrical  frequency,  a  is  the  angular 

subtense  of  the  system  in  the  scanning  direction,  and  t,]  is  the  dwell  time  of  the  image 
element  on  the  detector  element  [Ref.  3,  Eq.  5.57] .  This  simple  relationship  does  not  hold 
for  staring  systems,  nor  does  it  hold  in  the  cross-scan  direction.  In  a  staring  FPA,  the 
electrical  frequency  coiresponding  to  an  input  spatial  frequency  is  a  complicated  function 
of  the  system  clock-out  pattern  and  rate.  This  is  an  important  second  generation  effect  that 
will  be  addressed  in  Chapt^  m.  For  consistency,  all  frequencies  in  the  following  analysis 
are  spatial  frequencies,  typically  given  in  cy/mrad. 

Individual  sub-system  MTF’s  are  taken  from  a  variety  of  sources.  They  have  their 
origin  in  optics,  electronics,  diffraction  theory,  television,  and  video  standards.  G.  Holst 
has  compiled  an  excellent  treatment  of  the  origins  and  specifics  of  many  of  the  transfer 
functions  used  in  TIS  modeling  [Ref.  5].  Some  basic  transfo*  functions  are  presented  in 
the  following  paragrqihs  as  examples.  These  are  typical  of  those  used  by  Ratches  in  the 
derivation  of  the  NVL  Static  Performance  Model  [Ref.  1,  Chiq>ter  2],  and  by  Lloyd  in  his 
approximation  model  [Ref.  3,  Chapt^  3].  Most  of  the  first  generation  TIS  models 
develcqjed  have  used  these  or  similar  transfer  functions.  Second  generation  modeling  has 
necessitated  the  formulation  of  updated  models  as  discussed  in  subsequent  chapters. 

1.  Optical  Sub-system  Transfer  Function 

The  development  of  a  generalized  optical  transfer  function  requires  many 
assumptions  about  the  system  optics.  Most  TIS  system  optics  are  made  up  of  circularly 
symmetrical  elements.  In  a  focused,  diffraction-limited  system,  free  of  any  major 
aberrations,  the  MTF  is  given  by  the  autocorrelation  of  the  pupil  function  of  the  optic 
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elements.  Assuming  a  clear,  circular  aperture  with  uniform,  monochromatic,  planewave 
illumination,  the  MTF  is  given  by: 


1 


where  f  is  the  spatial  frequency  in  a  one-dimensional  analysis,  or  the  root  mean  square  of 
the  two-dimensional  frequency  components  in  a  two-dimensional  analysis.  Also,  f^.,  the 

optical  cutoff  frequency,  is  the  ratio  of  Dq,  the  effective  aperture  diameter,  and  X,  the 


incident  wavelength.  Spatial  frequencies  above  the  cutoff  will  be  blurred  oy  the  system 
optics.  This  transfer  function  only  applies  to  diffraction  limited,  incoherent,  perfectly 
focused  systems.  Any  aberrations  in  the  optical  elements  will  have  a  severe  degrading 
effect,  placing  a  high  quality  optics  requirement  on  the  design  of  TIS.  It  has  been  foimd 
that  the  above  equation,  evaluated  at  the  midband  wavelength,  can  be  used  to  represent 
small  wavelength  band  systems  with  no  significant  deviations  [Ref.  3,  Chapter  3]. 


2.  Detector  Sub-system  Transfer  Function 


The  detector  itself  will  have  two  effects.  It  acts  as  both  a  temporal  and  spatial  filter 
due  to  its  finite  dweU-time  and  finite  area,  respectively.  If  the  detector  dwell  time,  as 
controlled  by  the  frame  rate  of  the  system,  is  long  enough  for  the  quantum  processes  to  take 
place,  we  discount  the  quantum  temporal  filtering  effect  [Ref.  3,  Chapter  3].  To  determine 
the  spatial  transfer  function  due  to  the  finite  detector  size,  rectangular  geometry  is  usually 
assumed.  The  transfer  function  is  then  given  by  the  familiar  ‘Sine’  function  in  either  the 
X  or  y  directions: 


Hdet  = 


sin(7tafjj) 

naf„ 


sin(npfy) 


(1.10) 


where  a  is  the  horizontal  angular  subtense,  and  P  is  the  vertical  angular  subtense  of  a 
detector.  In  the  two  dimensional  MTF  analysis,  ‘x’  typically  corresponds  to  the  horizontal 
direction,  and  ‘y’  to  the  vertical. 
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3.  Electronics  Sub-system  Transfer  Function 


Once  the  incident  photon  energy  has  been  turned  into  an  electrical  signal  by  the 
detectOTCs),  the  signal  is  subject  to  the  filtering  effects  of  electronic  processing. 
Fortunately,  the  electrical  bandwidths  of  concern  are  usually  much  greater  than  the  spatial 
bandwidth  limits  imposed  by  the  other  sub-systems.  The  net  effect  of  the  electronic 
component  transfer  functions  cascaded  together  is  usually  taken  to  be  that  of  an  equivalent 
low-pass  filter  with  system  electronic  transfer  function  given  by: 

1 

=  +  (Ul) 

where  f^is  the  3-dB  bandwidth  of  the  low-pass  filter  equivalent,  converted  to  spatial 
frequency.  This  frequency  is  usually  obtained  by  measurement  of  the  impulse  response  of 
the  system  electronics.  An  electronics  PTF  is  also  often  included  [Ref.  3].  One  possible 
formulation  is: 

PTF.„„  =  .tan(-^  (1.12) 

4.  Display  Sub-system  Transfer  Function 

The  derivation  of  display  system  transfer  functions  is  of  extreme  intn'est  to 
television  and  video  industries.  A  CRT  display  transfer  function  historically  has  been 
treated  as  a  Gaussian  spread  fimction  based  on  the  pixel  size,  and  can  have  severe  phase 
artifacts  when  other  than  uni-directional  scanning  is  used.  The  effective  display  transfer 
function  is  given  by: 


Hd  =  exp(-qf^)  (1.13) 

where  q  is  a  monitor  factor  peculiar  to  a  specific  display  device.  The  "q’  factor  is  obtained 
from  the  two  dimensional  optical  spot  size  of  an  individual  pixel  in  the  display.  By  finding 
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the  spot  size  of  an  equivalent  Gaussian  spread  function  that  contains  the  same  energy  in  a 
given  radius  as  the  original  pixel  spread  function,  and  combining  all  constants  into  one 
term,  the  MTF  can  be  given  in  this  equivalent  form.  In  the  Lloyd  model,  the  equivalence: 

q  =  (1.14) 

is  used  [Ref.  3]. 

5.  Other  Transfer  Functions 

Other  transfer  functions  may  be  cascaded  with  the  net  system  transfer  function  if 
they  represent  an  effect  that  has  a  significant  impact  on  system  performance.  The 
incorporation  of  these  additional  transfer  fimctions  is  not  universal,  and  is  model  specific. 
Among  them  are  transfer  functions  representing  TIS  motion,  target  motion,  operator  visual 
processes,  system  time  constants,  and  other  parameters.  These  additional  effects  are 
discussed  at  length  in  Holst  [Ref.  5],  and  are  included  in  most  second  generation  models. 
The  most  contentious  of  these  is  the  appropriate  MTF  to  use  to  model  the  filtering 
characteristics  of  the  eye/brain.  This  effect  can  be  an  important  part  of  both  the  MTF 
analysis  and  the  calculation  of  system  bandwidths.  There  are  several  models  postulated 
for  this  filtering  effect.  The  first,  and  oldest,  is  a  synchronous  integrator  model  which 
treats  the  eye  as  a  spatial  and  temporal  integrator.  The  signal  to  noise  analysis,  then,  is 
defined  in  terms  of  target  area  and  time  integrations  [Ref.  2,  Appendix  D].  Other  models 
use  a  matched  filter  approximation  [Ref.  3].  In  this  case,  the  eye  filtering  effect  is 
^proximated  by  a  filter  matched  to  a  single  bar  of  the  target.  This  has  been  demonstrated 
to  be  t^plicable  to  the  eye/brain  process  over  small  areas  [Ref.  3].  The  NVL  1975  model 
is  based  on  a  matched  filter  concept.  A  third  alternative  is  to  treat  the  eye  as  a  bandpass 
filter  [Ref.  9].  This  model  assumes  a  normalized  peak  response  to  approximately  0.4  cy/ 
mrad,  followed  by  a  decay  associated  with  an  optical  transfer  function  based  on  the  finite 
pupil  size  of  the  eye.  This  MTF  treatment  agrees  well  with  measured  human  eye  responses 
[Ref.  9].  In  some  second  generation  models,  the  eye  is  treated  as  a  non-limiting  MTF, 
essentially  ignoring  the  filtering  effect  of  the  eye  entirely  [Ref.  16].  Some  authors  have 
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found  that  there  is  no  difference  in  predicted  performance  whether  the  eye  is  treated  as  a 
synchronous  integrator  or  a  matched  filter,  and  recommend  the  utilization  of  the  simpler 
synchronous  integrator  model  [Ref.  16].  Because  of  the  wide  disparity  of  opinion  on  this 
matter,  even  after  years  of  research,  it  is  desirable  that  a  new  predictive  model  make  no 
particular  assumptions  aboutthis  response,  tha-ebyrenderingtheconflictstrictlyacademic. 

6.  Net  Transfer  Function 

The  four  main  sub-system  transfer  functions  and  the  resultant  system  MTF  for  the 
example  first  generation  system  presented  in  Appendix  A  are  plotted  in  Fig.  1.3.  As 
predicted  by  the  central  limit  theorem,  the  cascade  of  the  sub-system  transfer  functions 
yields  a  near  Gaussian  system  transfer  function  [Ref.  6].  The  addition  of  other  transfer 
functions  to  the  cascade  inCTeases  this  tendency  toward  the  Gaussian.  Note  that  the  cascade 
does  not  incoiporate  any  sampling  effects  as  may  be  present  in  a  two  dimensional  array. 

7.  Detector  Sampling 

At  this  point  it  is  appropriate  to  discuss  the  dual  nature  of  the  detector  effect  on  the 
displayed  image.  The  effect  of  the  detectors  in  an  FPA  is  described  as  an  ^averaging 
sampling’  process  instead  of  a  ‘window  sampling’  process  [Ref.  3].  That  is,  the  detector 
element  of  dimensions  Ax  and  Ay  averages  the  signal  received  over  its  finite  active  area, 
and  accomplishes  a  sampling  process  due  to  the  pitch  between  detectors.  As  shown  below, 
an  averaging  sampling  process  is  equivalent  to  convolving  the  image  with  the  fimction 
described  by  the  detector  active  area  and  then  sampling  by  means  of  a  multiplication  by  a 
delta  function  at  the  location  of  the  detector  element,  6(x,y)  [Ref.  3,  Chapter  9].  For  a 
single  detector  located  at  (x,y),  the  spatial  ouq>ut  image  produced  by  the  detector  is 
described  by; 
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where  i(x,y)  is  the  image  function  and  o(x,y)  is  the  object  function  following  the  notation 
of  Ref.  3.  The  term  in  brackets  corresponds  to  the  averaging  effect  of  the  detector  element. 
Assuming  rectangular  geometry  and  recognizing  that  6(x,y)  has  non-zero  value  only  where 
X  and  y  are  both  zero,  the  bracketed  term  may  be  expressed  as: 

which  is  recognizable  as  the  convolution  integral.  If  the  conventional  ‘rect’  function  is 
used  to  describe  the  rectangular  detector  geometry  (rcct(x/a,y/b)=  1  for  -a/2<x<a/2,  -b/ 
2<::y<b/2,  else  =0)  The  output  image  becomes: 


In  the  spatial  frequency  domain: 


6(x.  y) 


(1.17) 


I(f^,fy)  =  [0(f^,  fy)  •  sinc(Axf^)  •  sinc(Ayfy)]  ®  6(nf3^,  mfjy)  (1.18) 


where  the  ‘sine’  function  is  defined  as  the  Fourier  transform  of  the  ‘rect’  function.  The 
sampling  delta  functions  are  repeated  at  integer  multiples  of  the  sampling  frequencies  in 
both  the  horizontal,  fgjf,  and  vertical,  fjy,  direction.  Equation  1.16  demonstrates  an 
important  but  often  overlooked  point  because  it  allows  the  detector  spatial  MTF  to  be 
considered  separately  from  its  position  in  the  sampling  array.  This  fact  is  used  in 
VISMODn  to  separate  the  two  effects.  The  term  in  the  brackets,  representing  the 
averaging  process  that  takes  place  over  the  active  area  of  the  detector,  takes  place  in  the 
spatial  frequency  domain  by  a  normal  MTF  analysis.  This  justifies  the  ^pearance  of  the 
Fourier  transforms  of  the  detector  shape  in  the  cascaded  transfer  function. 

Plotting  the  individual  and  total  MTF’s  make  it  easy  to  spot  limiting  system 
parameters,  and  to  identify  possible  design  trade-offs.  For  quick  analysis  and  ‘back  of  the 
envelope’  type  calculations,  the  net  transfer  function  can  be  replaced  with  a  simple 
exponential  [Ref.  3,  p.  11 1].  The  following  approximation  is  often  used: 
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(1.19) 


H3y3(f)  =  exp(-27ra^f^) 
where  a  is  the  standard  deviation  usually  obtained  gr^hically  from  plots  similar  to  Fig. 
1.3.  This  plot  quite  clearly  indicates  the  progressive  degradation  of  the  system  transfer 
function  with  increasing  spatial  frequency. 


Figure  1.3.  Example  of  a  cascaded  system  transfer  function 

F.  SYSTEM  PERFORMANCE  FIGURES  OF  MERIT 

There  are  many  system  parameters  from  which  the  sub-system  transfer  functions 
are  derived.  However,  the  system  transfer  function  by  itself  is  not  a  reliable  measure  of 
system  field  performance  because  it  does  not  include  noise  effects.  TnsfftaH,  the  laboratory 
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performance  of  an  imaging  system  is  most  often  stated  in  terms  of  its  target  discrimination 
capabilities.  The  modeling  of  the  thermal  imaging  process  is  an  attempt  to  predict  the 
ability  of  a  system  to  provide  the  requisite  degree  of  resolution  for  a  particular  application. 
Various  levels  of  discrimination  are  possible,  ranging  from  simple  detection  to  unique 
target  identiUcation  [Ref.  7,Chapter  2].  The  degree  of  discrimination  required  is 
determined  by  the  TIS  application.  Three  commonly  used  figures  of  merit  for  TIS  are 
based  on  the  discrimination  of  the  target  signal  from  noise,  and  are  derived  from  the 
electrical  signal  to  noise  ratio  (SNR)  of  the  system  output.  They  are,  the  noise  equivalent 
temperature  difference  (NETD),  the  minimum  detectable  temperature  difference  (MDTD), 
and  the  minimum  resolvable  temperature  difference  (MRTD). 

1.  NETD 


Most  figures  of  merit  for  a  TIS  are  referred  to  the  ouqjut  signal  compared  to  that  of 
the  output  noise.  Among  these  is  the  Noise  Equivalent  Temperature  Difference  (NETD). 
It  is  defined  as  the  minimum  temperature  difference  between  a  large  black-body  target  and 
background  that  must  exist  for  the  ouq)ut  signal  to  noise  ratio,  taken  just  prior  to  the  output 
display  of  the  system,  be  equal  to  one;  as  measured  with  a  standard  reference  filter  [Ref.  7]. 
The  noise  equivalent  temperature  difference  (NETD)  for  a  typical  TIS  is  given  by: 


NETD  = 


(1.20) 


where  AT  is  the  radiation  temperature  difference  between  target  and  background.  When 
the  ratio  in  the  denominator  is  set  to  one  (i.e.  the  signal  to  noise  ratio)  the  temperature 
difference  is  defined  to  be  the  NETD.  NETD  derivation  takes  different  forms  for  different 
authors,  but  all  can  be  summarized  as  finding  appropriate  expressions  for  Vg  and  V^,  setting 

their  ratio  equal  to  one,  and  solving  for  the  appropriate  AT.  The  differences  in  the  various 
formulations  of  the  NETD  are  minor,  but  the  assumptions  that  form  the  basis  of  the  NETD 
are  basically  the  same  for  all  derivations  These  assumptions  include  black-body  radiation 
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sources,  a  standardized  electronics  transfer  function,  a  large  target,  and  a  signal  to  noise 
ratio  measured  prior  to  the  monitor  display.  The  NETD,  although  valuable,  has  numerous 
deficiencies  as  a  figure  of  merit  [Refs.  1,3,  and  7].  The  fact  that  the  measurement  point 
does  not  include  the  display,  exclusion  of  observer  perception  factors,  and  the  use  of  a 
standard  reference  filter,  limits  its  usefulness  in  modeling  the  resolution  capability  of  a 
system.  Nevertheless,  the  NETD  can  be  a  useful  indicator  of  system  performance,  and  is 
used  as  a  building  block  to  model  more  sophisticated  figures  of  merit. 

2.  MDTD  and  MRTD 

The  shortcomings  in  the  NETD  model  made  it  necessary  to  identify  a  better  figure 
of  merit.  The  figure  of  merit  most  popularly  adopted  by  the  community  has  been  the 
MRTD  and,  less  commonly,  MDTD.  These  figures  have  the  benefit  of  referring  to  the  final 
image  displayed  by  the  TIS  and  interpreted  by  the  observer.  MDTD  is  defined  as  the 
minimum  temperature  difference  required  for  a  trained  observer  to  be  able  to  detect  the 
presence  of  a  large  target  in  a  displayed  image.  MRTD  is  defined  as  the  minimum  apparent 
temperature  difference  required  between  target  and  background  in  order  for  a  user  to 
resolve  a  standard  four  bar  target  pattern  [Ref.  3,  Chapter  5] .  It  is  a  unified  system-observer 
performance  criterion  that  goes  beyond  the  electrical  SNR  used  by  the  NETD.  Since  most 
military  applications  of  TIS  require  the  detection  or  resolution  of  objects  in  a  scene  based 
on  the  differences  in  their  radiation  temperatures,  this  is  a  valuable  property.  A  strong 
correlation  between  field  performance  of  a  TIS  and  its  MRTD  has  been  demonstrated  [Refs. 
1  and  2] .  Properly  modeling  the  dependence  of  MRTD  on  spatial  frequency  and  system 
parameters  is  a  convenient  way  to  evaluate  and  compare  systems,  and  to  predict  their 
suitability  for  a  given  task. 

The  MRTD  is  measured  in  the  laboratory  as  a  function  of  the  radian  spatial 
frequency  of  a  standard  four-bar  pattern,  which  consists  of  four  vertical  bars  with  height 
seven  times  their  width,  with  spacing  equal  to  the  width  of  one  bar,  as  pictured  in  Fig.  1.4. 
The  fundamental  spatial  frequency  (in  cy/mrad)  of  the  bar  pattern  is  defined  by  the  width 
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of  a  single  bar,  and  the  distance  from  the  pattern  to  the  observer.  If  the  width  of  one  bar  is 
W  (cm)  and  the  observer  distance  is  R  (cm),  then  the  fundamental  spatial  frequency  is  given 
by: 


f  =  A  f  cy  ^ 

*  2W  IradJ  2W  ImradJ  ’ 


(1.21) 


The  standard  four  bar  pattern  currently  used  in  TIS  modeling  is  derived  from  an 
earlier  tiiree  bar  resolvability  aiterion  developed  for  motion  picture  standards,  and  adapted 
to  TIS  [Ref.  3,  Chapter  5] .  The  assumptions  of  black-body  radiation,  large  target,  and  SNR 
measured  prior  to  the  display,  still  apply  to  MRTD  modeling.  In  addition,  the  most 
common  formulations  of  an  MRTD  model  assume  a  finite  eye-brain  spatial  integration 
period  (typically  about  0.2  seconds),  a  threshold  signal  to  noise  level  for  target  detection 
(typically  about  4.5),  and  a  matched  filter  response  by  the  eye  of  the  observer  [Refs.  1  and 
3].  These  assumptions  are  considered  to  be  a  minimum  set  required  to  qjproximate  the 
eye’s  performance  [Ref.  3,  Chapter  5].  The  derivation  of  an  MRTD  prediction  model,  like 
the  NETD  model,  has  taken  several  different  forms  since  its  acceptance  as  a  figure  of  merit 
for  TIS.  Although  each  derivation  has  its  own  distinctive  emphasis,  the  differences  tend  to 
be  ones  of  definition  and  approximation.  Three  treatments  of  MRTD  in  first  generation 
modeling  will  be  presented  in  the  next  chapter.  The  motivation  to  use  the  MRTD  instead 
of  the  NETD  as  a  figure  of  merit  arises  because  the  MRTD  includes  the  frequency 
dependent  blurring  effect  of  the  TIS,  as  well  as  a  link  to  a  human  resolvability  criterion 
(Johnson  criterion)  [Refs.  5  and  7].  However,  the  MRTD  still  has  some  undesirable 
pi  operties.  Unfortunately,  the  inherent  subjectivity  of  the  resolvability  criterion  gives  the 
MRTD  a  less  than  scientific  characteristic.  The  subjectivity  of  the  observer  can  be 
minimized  through  observer  training,  but  the  results  are  mostly  unrepeatable,  and  differ 
among  individual  observers.  The  MRTD  also  suffers  from  other  drawbacks  that  are 
especially  relevant  to  second  generation  systems.  As  it  is  presently  formulated,  the  MRTD 
cannot  accoimt  for  signal  processing  effects,  image  enhancement,  image  manipulation,  and 
non-uniformity  correction  in  detector  arrays  [Ref.  8] .  Despite  these  drawbacks,  the  MRTD 
remains  the  principal  figure  of  merit  for  laboratory  performance  of  thermal  imaging 
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systems.  It  will  remain  so  until  a  satisfactory  objective  resolution  figure  of  merit  is  adopted 
by  the  thermal  imaging  community. 


Figure  1.4.  Standard  four-bar  resolvability  targets 


G.  MOTIVATION  FOR  THIS  WORK 

For  staring  FPA  based  imagers,  the  principle  of  operation  is  significantly  different 
than  for  first  gen^-ation  systems.  Predictive  models  that  have  been  introduced  so  far  for 
second  generation  systems  are  typically  extensions  of  first  generation  systems  with  a 
correction  factor  implied  to  account  for  directional  noise  effects.  It  has  been  suggested  that 
these  models  are  inadequate  for  predicting  FPA  based  imager  performance  [Refs.  8,26,  and 
39].  FLIR92  is  an  excellent  program  to  account  for  three  dimensional  noise  effects,  but 
it  does  not  model  sampling  effects,  and  does  not  provide  any  evaluation  data  beyond  the 
system  Nyquist  frequency.  A  new  second  generation  model  is  required  that  can  handle 
second  generation  systems  that  experience  severe  sampling  and  scene-phasing  effects. 
This  model  should  make  no  assumptions  about  the  observation  process,  so  that  it  can  easily 
be  extended  to  a  TIS  that  uses  an  ATR  device  instead  of  a  human  observer.  The  model 
should  extend  performance  prediction  beyond  the  system  Nyquist  range.  Finally,  there  is 
a  dearth  of  published  laboratory  measurement  data  for  TIS .  It  is  necessary  to  malcft  some 
MRTD  measurements  using  the  staring  FPA  systems  available  in  order  to  better  evaluate 
the  performance  of  the  various  predictive  models. 
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II.  FIRST  GENERATION  MRTD  MODELS 


This  chapter  follows  the  historical  development  of  TIS  modeling,  moving  beyond 
basic  system  characterization  to  implementation  in  predictive  modeling.  An 
understanding  of  these  older  models  is  necessary  in  order  to  understand  the  second 
generation  modeling  refinements  addressed  in  the  remaining  chq^ters.  The  first  model 
considered,  the  Night  Vision  Laboratory  (NVL)  static  performance  model  (SPM),  also 
referred  to  as  the  ‘Ratches’  model  for  one  of  its  principal  authors,  was  first  presented  in 
1975  [Ref.  1].  The  Ratches  model  predicts  NETD,  MDTD,  and  MRTD  for  scanning 
thermal  imaging  systems.  It  is  of  particular  significance  because  it  was  one  of  the  first 
widely  adopted  analytical  models  for  TDS  performance  prediction.  The  second  model 
reviewed  is  the  Lloyd  model.  The  Lloyd  model  was  similar  to  Ratches,  but  had  the  benefit 
of  being  much  simplified  through  some  basic  assumptions.  The  Lloyd  model  also  received 
widespread  attention  because  of  the  popularity  of  Lloyd’s  text  on  the  subject  of  TIS  [Ref. 
3].  These  first  two  are  considered  established  first  generation  reference  models  by  the 
entire  TIS  community.  Although  somewhat  dated,  they  serve  as  a  point  of  departure  for 
more  modem  second  generation  models.  The  treatment  of  these  two  models  will  be 
mercifully  brief,  providing  only  enough  backgroimd  to  enable  the  reader  to  better 
understand  the  contents  of  later  chapters.  A  third  first  generation  model  discussed  is  the 
‘visibility’  model,  presented  in  1994  by  R.  Pieper  and  A.  Cooper  of  the  U.S.  Naval 
Postgraduate  School  [Ref.  9].  The  visibility  method  presented  is  a  simplified  MRTD 
prediction  model  based  on  a  minimiun  threshold  resolvable  temperature  diffo-ence  specific 
to  the  US.  This  model  has  better  correlation  with  measured  MRTD  data  than  the  other  two. 
Additionally,  the  visibility  model  serves  as  a  basis  for  the  new  second  generation  visibility 
model,  VISMODH,  developed  in  Chapter  V.  Because  the  fundamental  concepts  of  the 
visibility  model  ^ply  to  second  generation  modeling  with  equal  validity,  it  will  be  treated 
in  greater  detail  than  the  Ratches  or  Lloyd  models. 
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A.  NIGHT  VISION  LABORATORY  STATIC  PERFORMANCE  MODEL 


The  Ratches  model  presented  in  1975  was  a  defining  work  in  the  modeling 
community,  and  served  as  the  standard  MRTD  prediction  model  for  over  a  decade.  It  is 
also  the  foundation  from  which  the  currently  popular  FLIR  92,  a  second  generation  model, 
is  derived.  The  Ratches  model  is  a  computer  based  model  developed  by  the  U.S.  Army’s 
Night  Vision  Laboratory  for  the  development  and  evaluation  of  Army  infrared  systems  for 
a  variety  of  applications.  It  is  a  ‘static’  performance  model  since  it  does  not  consider  target 
acquisition  and  positioning  concerns  for  actual  field  systems.  Instead,  it  was  developed  as 
an  attempt  to  analytically  predict  system  performance  based  on  device  parameters.  One 
critical  assumption  of  the  Ratches  model  is  that  laboratory  MRTD  performance  directly 
correlates  with  actual  field  performance  [Ref.  1].  The  Ratches  derivation  of  MRTD  follows 
the  signal  to  noise  ratio  (SNR)  analysis  as  descaibed  in  Chapter  I,  using  linear  systems 
theory. 

A  key  element  in  the  Ratches  model  is  the  mathematical  representation  of  the 
observation  process,  based  on  quantification  of  existing  laboratory  perception  data  [Ref.  1]. 
Ratches  models  the  eye-brain  process  as  a  matched  filter  for  a  one  bar  pattern.  This  implies 
a  hypothetical  filtering  of  both  signal  and  noise  with  a  filter  matched  to  one  bar  of  the  target 
pattern.  The  consequence  of  this  modeling  is  the  inclusion  of  two  perceived  signal-to- 
noise  ratio  improvements  in  the  eye-brain  process.  The  matched  filter  modeling  and  the 
finite  integration  time  of  the  eye  each  results  in  improved  resolvability  performance,  and 
is  an  important  parameter  for  any  TIS  with  a  human  observer  in  the  loop.  Another  eye- 
brain  process  included  is  a  perceived  SNR  threshold  for  resolution.  Recall  in  the  NETD 
derivation  that  the  signal  to  noise  ratio  was  set  to  one.  The  threshold  value  for  resolution 
is  actually  postulated  to  be  2.25  by  the  Ratches  model,  corresponding  to  a  probability  of 
detection  of  50  percent.  [Ref.  1] 

The  noise  characteristics  of  the  Ratches  model  are  completely  specified  by  the 
NETD.  The  Ratches  model  uses  the  following  formulation  for  NETD: 
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4F^(Af_)^ 

NETD  =  — j - - [Kelvin]  ,  (2.1) 

TiAdTjXoA^J"  D*(X)Tl;^dA 

where  F  is  the  system  ‘F’  number  ( the  ratio  of  focal  length  to  optics  diameter),  A4  is  the 
noise  bandwidth,  is  the  detector  area,  xq  is  the  optics  transmission  factor,  x^  is  the 
atmospheric  transmission  factor,  N  is  the  munber  of  detectors,  and  the  integral  term 
represents  the  response  of  the  detector  to  the  incremental  change  in  target  radiance  for  an 
incremental  change  in  temperature  [Ref.  1,  Eq.  24].  The  T];^  term  is  a  shorthand  notation 
used  by  Ratches  to  represent  the  temperature  derivative  of  the  Planck  radiation  function 
[Ref.  I,  p.  12] .  An  important  feature  of  the  NETD  derivation  is  the  calculation  of  a  noise 
bandwidth  to  be  used.  In  the  Ratches  model,  this  bandwidth  is  fundamentally  determined 
by  the  measurement  filter.  The  NETD  derivation  assumes  that  the  filtering  action  of  the 
electronics  prior  to  measurement  conforms  to  the  standard  low-pass  filtra*  given  as  Eq.  1 . 1 1 . 
If  the  detector  noise  can  be  considered  white,  then  the  noise  bandwidth  is  taken  to  be: 

=  Ksrj 

with  Xjj  given  as  the  dwell  time  of  the  detector  [Ref.  1,  Eq.  22].  (This  does  not  refer  to  the 
'clock-out’  time  of  a  staring  array  that  will  be  discussed  in  Cluster  m.  The  detector  dwell 
time  is  the  time  for  which  a  given  detector  element  is  illuminated  by  a  given  scene  element. 
One  of  the  great  advantages  of  staring  arrays  is  that  the  dwell  time  is  greatly  increased, 
thereby  reducing  the  noise  bandwidth.)  The  Ratches  model  assumes  no  sampling  artifacts 
in  the  scan  direction,  a  subject  of  great  interest  in  second  gen^ation  modeling. 

The  sub-system  transfer  functions  used  in  the  Ratches  model  were  presented  in 
Chapter  I.  In  addition  to  the  cascade  of  four  basic  sub-system  transfer  functions  previously 
described,  Ratches  includes  three  additional  sub-system  transfer  functions  in  the  cascaded 
system  MTF.  These  MTF’s  are  stated  here,  without  derivation,  for  completeness  only. 
The  reader  should  refer  to  Ref.  1  if  more  detail  is  required.  (In  the  cascade  analysis  that 
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follows,  the  value  of  these  additional  factors  will  be  set  to  ‘  1’.)  The  first  is  a  transfer 
function  of  the  eye: 

-rf 

=  e  “  (2.3) 

where  the  eye  MTF  exists  in  both  the  x  and  y  directions,  and  F  and  M  are  light  level  and 
magnification  parameters  respectively  [Ref.  1,  Eq.  20].  Second,  the  Ratches  model  adds  a 
stabilization  MTF  to  accoimt  for  vibrations  in  the  TIS  device: 

Hlos  =  (2.4) 

where  P  is  calculated  from  the  variance  of  device  vibration  [Ref.  1,  Eq.  19].  Third,  Ratches 
includes  an  electronic  boost  MTF  for  systems  so  configured.  The  sub-system  transfer 
function  is  given  by: 

=  (2.5) 

where  K  and  f^ax  determine  the  amplitude  and  frequency  of  boost,  converted  to  the 
tqjpropriate  spatial  frequency  values  [Ref.  1,  Eq.  16]. 

The  overall  system  MTF  including  these  additional  factors  is  calculated  to  predict 
the  signal  transfer  characteristics  of  the  entire  system  for  spatial  frequency  components  in 
the  horizontal  and  vertical  directions.  Horizontal  spatial  frequency  is  typically  given  by  fjj, 
and  the  vertical  by  fy.  In  the  first  generation,  the  horizontal  MRTD,  corresponding  to  the 

spatial  frequency  established  horizontally  by  the  bars  in  the  pattern,  was  the  dominant 
concern.  The  overall  system  MTF’s  (setting  the  additional  MTF’s  equal  to  1 .0)  are 
represented  as: 

“  ^opt^det^elec^d  (2.6) 

and, 

^sys(^y)  “  ^opt^det^d  (2.7) 
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Ratches  formulates  the  horizontal  MRTD  from  the  calculated  NETD  and  MTF  as 
given  in  Eq.  2.1  and  Eq.  2.6.  MRTD  as  a  function  of  spatial  frequency  is  predicted  from 
device  parameters .  Several  formulations  of  the  MRTD  are  given  by  Ratches,  with  the  most 
general  form  being: 

MRTDr= 


(|JSNR.„NETD  r 

Vdo.‘. 


JJo 


S(f,> 

s(U 


r 


(2.8) 

[Ref.  1 ,  Eq.  A45] .  The  variables  in  the  above  equation  include  the  threshold  signal  to  noise 
ratio,  SNR^  the  vertical  instantaneous  field  of  view  in  nnad,  Ay^;  the  scan  velocity,  v;  the 
frame  rate,  and  the  eye  integration  time,  t^.  Also,  Hl  and  refer  to  the  Fourier 
transform  of  a  single  bar  in  the  long  and  short  dimensitm  respectively.  This  formulation 
of  MRTD  assumes  the  bar  pattern  can  be  treated  as  a  periodic  function  in  the  horizontal 
direction,  and  that  the  signal  is  obtained  by  taking  the  difference  betwem  the  output  of  die 
matched  filter  when  centered  over  the  displayed  bars  and  when  centered  over  the 
backgroimd  [Ref .  10,  p.  21].  Note  that  this  is  a  horizontal  MRTD.  An  unvalidated  vertical 
MRTD  is  also  included  in  the  Ratches  model  [Ref.  1,  p.  13].  When  plotted  fw  the  sample 
first  generation  system  given  in  ^pendix  A,  the  MRTD  prediction  curve  given  by  Ratches 
looks  like  Hg.  2. 1 ,  where  it  is  shown  plotted  with  the  Lloyd  and  visibility  model  prediction 
curves.  The  plots  are  made  on  a  log  scale  to  bettm*  show  the  differences  between  the 
predictions  of  the  three  models.  The  Ratches  model  gives  MRTD  predictions  that  match 
measured  data  quite  reasonably  except  for  being  consistently  too  pessimistic  at  low  spatial 
frequencies,  and  too  optimistic  at  high  frequencies. 
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Figure  2. 1 .  MRTD  prediction  plots  from  three  first  generation  models 


B.  THE  LLOYD  APPROXIMATE  MODEL 

Lloyd’s  model  for  MRTD  prediction  [Ref.  3,  Chapter  5]  appeared  near  the  same 
time  that  the  Ratches  model  was  introduced.  Since  Lloyd’s  text  served  as  the  main  primer 
for  TIS  education  for  many  years,  his  formtilation  for  MRTD  remains  popular.  As  with  the 
Ratches  model,  understanding  of  the  Lloyd  model  for  MRTD  prediction  requires  an 
understanding  of  his  treatment  of  noise  and  the  human  observer. 

Lloyd’s  deflnition  of  NETD  is  the  same  as  Ratches,  but  the  formulation  he  uses  is 
different.  Lloyd,  like  Ratches,  uses  the  standard  reference  filter  to  define  the  noise 
bandwidth  of  the  system; 
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MTF,,f 


fN2-,-0.5 


-i-m 


where. 


f  =  — 

2t. 


(2.10) 


This  allows  all  video  ou^ut  noise  to  be  directly  related  to  the  detecfoM*,  and  assumes  that  no 
other  electronic  processing  noise  is  introduced.  Atmospheric  ejects  are  assumed  to  be 
negligible  since  they  operate  on  both  the  target  and  background  radiation.  Some  highlights 
of  Lloyd’s  derivation  are  given  below  to  give  the  reader  a  sense  of  the  origin  of  his  results. 
[Ref.  3] 

Starting  with  the  spectral  radiance  received  from  the  target: 


Nx  = 


m  pmsr 


(2.11) 


it  is  a  quick  jump  to  the  differential  power  received  at  the  detector  for  a  diffoential  change 


in  temperature: 


-  Pa  ...aw  r  W  ^ 
dT  lpm“Kj  ‘ 


(2.12) 


Including  the  detectivity  to  convert  this  incremental  power  to  signal  voltage,  and 
including  a  system  optics  transmission  parameter,  Tq,  gives: 


NETD  = 


^  * 

oPA(,t„D*(Xp)  J  Aw(X, 


(2.13) 


where  NETD  corresponds  to  a  signal  to  noise  ratio  of  one  in  the  small  signal  approximation 
[Ref.  3,  Eq.  5.19].  In  this  case,  a  and  P  are  tiie  angular  subtenses  of  the  detector,  and  W 
is  the  spectral  radiance  at  the  detector.  This  can  be  shown  to  be  equivalent  to  Ratches’ 
formulation  given  as  Eq.  2. 1  if  it  is  recognized  that  the  F  number  of  a  system  is  the  ratio  of 
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the  system  focal  length  to  the  collecting  aperture  diameter,  and  that  the  field  of  view  may 
be  written  as, 

aP  =  ^.  (2.14) 

F 

Armed  with  an  equivalent  formulation  for  the  NETD,  Lloyd  proceeds  with  the 
derivation  of  MRTD.  Like  Ratches,  Lloyd  seeks  to  obtain  a  predictive  model  which 
includes  all  elements  of  the  TIS -observer  system.  Although  noting  the  many  possible 
considerations  that  could  impact  image  quality  (e.g.,  random  noise,  clutter,  detector 
nonuniformities,  contrast,  among  others)  Lloyd  emphasizes  the  dominant  effect  of  spatial 
and  thermal  resolution  on  TIS  performance.  Lloyd  assumes  both  a  temporal  integration 
time  for  the  observer  eye  as  0.2  s,  and  a  matched  filter  modeling  of  the  eye  [Ref.  3,  p.  183]. 

A  unique  characteristic  of  the  Lloyd  derivation  is  the  consideration  of  the  system 
response  to  a  square  wave  input,  as  represented  by  the  bar  pattern  in  the  scan  direction. 
Lloyd  notes  that  the  square  wave  can  be  represented  as  the  sum  of  a  Fourier  series  of 
components  containing  the  odd  harmonics  of  die  square  wave  fundamental  frequency,  and 
argues  that  the  higher  harmonics  of  this  series  will  be  removed  due  to  the  filtering  action 
of  the  system  MTF.  This  will  leave  only  the  scaled  fundamental  sinusoidal  component. 
Substituting,  the  system  response  to  the  square  wave  can  be  replfu:ed  by  the  system 
response  to  the  scaled  first  sinusoidal  harmonic: 

,  (2.15) 

where  OHjyjlf)  is  the  system  square  wave  response,  and  H^,(f)  is  the  normal  system 
sinusoidal  response. 

In  addition  to  the  standard  SNR  derivation,  Lloyd  includes  four  SNR  improvements 
he  terms  ‘perception  factors’  [Ref.  3,  p.l86].  First,  he  notes  an  averaging  effect  of  the  eye 
on  the  signal  received.  This  results  in  an  SNR  improvement  by  a  factor  of  2/n.  Second,  he 

notes  an  SNR  improvement  of  (t^Fdot)'^  due  to  temporal  integration  by  the  eye.  Third,  he 
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notes  a  vertical  integration  along  the  bars  of  the  target  giving  another  perceived  SNR 
improvement  of  [7/(2  f^P)]"^.  Finally,  he  replaces  the  noise  bandwidth  of  the  standard  filter 
with  one  accounting  for  the  eye’s  matched  filter  action.  Setting  the  new  and  improved 
perceived  SNR  equal  to  the  SNR  threshold  required  for  resolution  (Lloyd  uses  4.5, 
corresponding  to  a  detection  probability  of  90%)  and  combining  the  perception  factor 
constants,  gives: 


MRTDJf)  =  0-^(SNR^,)(NETD)(f).  y. 

(Af„)°'^MTF(f)  VF^otteV 


(2.16) 


which  is  equivalent  to  Ref.  3,  Eq.  5.58.  As  seen  in  Fig.  2. 1 ,  Lloyd’s  predicted  MRTD  curve 
for  a  sample  system  has  the  same  shape  as  the  Ratches  model  curve. 

It  can  be  shown  that  the  Lloyd  and  Ratches  models  can  be  related  by  a  frequency 
dependent  conversion  factor  [Ref.  9].  This  factor  is  obtained  by  taking  the  ratio  of  the  two 
formulations  for  MRTD,  cancelling  like  terms,  and  by  applying  a  few  low  frequency 
assumptions  given  in  the  Ratches  model.  The  derivation  of  thi.s  conversion  factor  is 
contained  in  Appendix  B.  The  final  conversion  factOT  is  repeated  here  for  reader 
convenience: 


[2WLJ  Of  J 

X(f,)  =  ^ - -  .  (2.17) 

where  and  Hl  are  the  Fourier  transforms  of  a  single  bar  in  the  x  and  y-directions 
respectively,  and  L  is  the  vertical  dimension  of  the  bar  [Ref.  9,  Eq.  c2].  If  the  low  frequency 
approximations  for  low  spatial  frequencies  are  applied,  this  conversion  factw  goes  to  one 
in  the  low  frequency  limit  [Ref.  1].  This  indicates  diat  the  Lloyd  and  Ratches  models 
converge  in  the  low  frequency  limit.  This  is  also  {^parent  from  Fig.  2.1 . 
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C.  nRST  GENERATION  VISIBILITY  MODEL 


In  spite  of  the  success  of  both  the  Ratches  model  and  the  Lloyd  model,  there  are 
notable  discrepancies  between  the  MRTD  performance  that  these  models  predict  and  actual 
measured  performance.  In  particular,  these  models  tend  to  be  too  optimistic  at  low  spatial 
frequencies,  and  too  pessimistic  at  high  spatial  frequencies.  The  low  frequency  trend  is 
particularly  disturbing  in  the  limit  as  the  spatial  frequency  goes  to  zero.  As  the  target 
spatial  frequency  approaches  this  low  frequency  limit,  the  Ratches  and  Lloyd  models  both 
indicate  that  the  expected  MRTD  would  go  to  zero  as  well.  Clearly,  this  is  counterintuitive, 
as  one  woxild  expect  a  threshold  contrast  to  exist,  below  which  the  TIS  could  not  resolve  a 
target.  Measured  laboratory  data  also  indicates  that  some  threshold  level  of  thermal 
contrast  for  perception  exists.  In  addition,  the  subjectivity  of  the  MRTD  measurement 
process  is  disturbing.  This  subjectivity  and  non-repeatability  are  the  result  of  the 
difficulties  inherent  in  including  human  observers  in  the  loop  and  modeling  the  resolution 
process  of  the  eye-brain.  [Ref.  9] 

It  was  also  important  that  an  objective  MRTD  prediction  model  be  derived  to 
support  an  objective  resolvability  standard,  such  as  would  be  required  by  an  automatic 
target  recognition  device  (ATR).  The  models  in  existence  prior  to  the  develc^ment  of  the 
visibility  model  were  inseparably  tied  to  the  recognition  process  of  a  human  observer.  As 
the  state  of  the  art  of  thermal  image  processing  continues  to  evolve,  the  human  observer’s 
tasks  of  detecting,  resolving,  or  identifying  a  target  are  rapidly  being  replaced  with 
automatic  detection  algorithms.  The  visibility  model  described  is  a  first  generation  effort 
to  address  these  concerns.  The  visibility  model  provides  a  simpler  development  for  MRTD 
prediction  based  on  a  critical  system  response,  and  a  degraded  contrast  transference  due  to 
spatial  frequency  limitations  of  the  sub-systems,  rather  than  a  subjective  ‘perceived  SNR’ 
criterion.  The  concept  of  using  a  contrast  transference  instead  of  a  strict  MTF  analysis  is 
not  uiuque  to  the  visibility  model  [Ref.  11].  The  fundamental  arguments  that  support  the 
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first  generation  visibility  model  apply  equally  well  to  second  generation  systems,  and  are 
used  in  the  second  generation  visibility  model  as  well. 

1.  Visibility  Model  Origins 

In  previous  first  generation  models,  MRTD  performance  was  modeled  as  the 
attainment  of  a  threshold  signal  to  noise  ratio.  Generally,  these  derivations  first  developed 
the  NETD  required  to  achieve  an  SNR  of  one  from  system  parameters.  Next,  the  NETD 
was  modified  by  SNR  degradation  and  improvement  factors  that  corresponded  to  the 
particular  method  used  to  model  the  recognition  process.  Some  of  these  SNR 
modifications  were  dependent  on  the  spatial  fiequency  of  the  four  bar  pattern,  others  wo’e 
not.  This  suggests  a  form  for  the  MRTD  that  can  be  separated  into  two  fachxs,  one 
frequency  dependent,  the  other  not.  The  frequency  dependent  term  would  be  derived  from 
the  sub-system  MTF’s  and  PTF’s.  The  other  term  would  be  a  constant  fix  a  particular 
system,  and  would  account  for  noise  performance,  eye-brain  signal  enhancements,  and  all 
other  factors  independent  of  the  target  spatial  frequency.  The  second  term  would  represent 
the  MRTD  for  the  system  in  the  low  frequency  limit.  The  representation  used  in  the 
visibility  model  is; 

MRTD(f^)  =  [MRTD(f^^O)][l/(a(fJ)l  (2.18) 

where  the  a(f^)  term  is  a  contrast  transference  parameter  that  depends  on  spatial  frequency, 
presumably  obtainable  from  sub-system  parameto:^  or  by  direct  measurement.  The  low 
frequency  limit  of  the  MRTD  corresponds  to  a  minimum  system-degraded  temperature 
difference  that  could  be  recognized  by  the  sensor/observer  [Ref.  9].  This  representation  has 
intuitive  appeal  because  the  MRTD  would  go  to  a  minimum  (non-zero)  threshold  value  in 
die  low  frequency  limit.  Note  that  this  is  consistent  with,  but  different  from  the  ^proach 
espoused  by  the  Ratches  and  Lloyd  models.  The  MRTD  performance  of  the  US  can  then 
be  obtained  from  the  two  factors  alone,  one  of  which  is  a  constant.  Once  the  contrast 
transference  parameter  is  known,  either  through  measurement  or  calculation,  the  MRTD  is 
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easily  obtained.  The  low  frequency  limit  term  incorporates  the  eye-brain  recognition 
process,  without  making  any  particular  assumptions  about  its  nature.  It  simply  represents 
the  input  temperature  corresponding  to  the  minimum  degraded  contrast  that  can  be  detected 
for  a  given  system  in  the  low  frequency  limit  where  the  bar  pattern  appears  as  a  simple  step 
fimction.  The  minimum  degraded  contrast  that  can  be  detected  by  an  ATR  device  can  be 
a  complex  function  of  the  device’s  signal  processing  characteristics  and  sensitivity.  The 
deHnition  of  the  threshold  contrast  makes  no  assumptions  about  either  the  recognition  or 
the  noise  processes,  nor  even  the  observer.  As  such,  it  is  consistent  with  an  objective  or 
‘machine’  measured  MRTD.  It  has  the  ac’iitional  virtue  of  being  simple  to  understand  and 
to  implement.  To  implement  the  visibility  concept  it  is  necessary  only  to  find  the  low 
fi’equency  threshold  term,  and  model  the  frequency  dependent  contrast  reduction  induced 
by  die  system.  Figure  2.2  portrays  the  salient  features  of  the  visibility  model. 


Figure  2.2.  Contrast  degradation  in  the  visibility  model,  after  Ref.  9 


Figure  2.2  clearly  demonstrates  the  visibility  model  concept  of  a  system  degraded  contrast 
transference.  The  four  bar  pattern  input  signal  is  characterized  by  the  temperature 
difference  between  target  and  backgroimd,  portrayed  as  AT.  This  signal  is  degraded  and 
filtered  by  the  frequency  dependent  characteristics  of  the  various  sub-systems  (i.e.,  transfer 
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functions).  When  the  image  is  displayed  at  the  output,  the  bar  pattern  still  displays  the  same 
fundamental  frequency  corresponding  to  the  bar  width,  w,  but  the  higher  harmonics  of  the 
square  wave  input  have  been  filtered  out.  The  contrast  in  the  ouq)ut,  defined  as  the  dynamic 
range  of  the  signal,  has  been  reduced  to  AT^.  The  premise  of  the  visibility  model  is  that 
only  two  parameters  are  necessary  to  predict  the  MRTD  for  the  system.  First,  the  contrast 
transference  parameter  as  a  function  of  spatial  frequency  must  be  calculated  from  the 
square  wave  response  of  the  system.  Second,  the  minimum  threshold  resolvable  contrast 
in  the  ouq>ut  must  be  determined. 

2.  Contrast  Transference  Parameter 


The  frequency  dependent  contrast  transference  parameter,  as  implied  by  Fig.  2.2, 
is  a  fimction  of  the  sub-system  MTF’s.  The  four  bar  target  source  is  treated  as  a  square 
wave  with  amplitude  determined  by  the  radiation  temperature  difference  between 
background  and  foreground  temperature,  AT.  This  incident  square  wave  can  be 
represented  by  a  Fourier  series  of  sinusoidal  components  of  amplitude-scaled  odd 
harmomcs  based  on  the  radian  spatial  fi-equency  of  the  bar  pattern.  It  is  apparent  that  the 
filtering  effect  of  the  sub-system  transfer  functions  will  eliminate  or  degrade  some  or  aU  of 
the  components  of  the  original  square  wave.  As  a  result,  the  measured  output  signal,  AT,, 
will  have  a  reduced  dynamic  range.  For  example.  Fig.  2.2  shows  that  all  frequency 
components  greater  than  the  fundamental  frequency  have  been  filtered  out  The  result  is  a 
contrast  reduction  in  the  ouq^ut.  The  ratio  of  the  output  contrast  to  the  il^>ut  contrast  is 
defined  as: 


«(fx)  = 


AT,(f) 

AT 


(2.19) 


The  a(fx)  parameter  is  a  function  of  spatial  frequency,  and  relates  input  to  ouq>ut  dynamic 
range  (contrast).  In  the  visibility  model,  this  parameter  is  obtained  by  calculating  the 
square  wave  response  of  the  system  using  Fourier  construction.  The  parameter  is 
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calculated  as  the  ratio  of  contrast  found  in  the  ou^ut  signal  to  that  of  the  input  square  wave 
at  a  particular  frequency.  In  the  visibility  model,  this  parameter  was  evaluated  with  and 
without  phase  artifacts,  with  the  interesting  result  that  MRTD  prediction  was  not  affected 
by  the  inclusion  of  the  PTF  portion  of  the  system  OTF.  A  plot  of  a(f^)  for  the  sample 
system  given  in  Appendix  A  is  plotted  in  Fig.  2.3. 


Figure  2.3.  Visibility  model  contrast  transference  parameter 
3.  Low  Frequency  Threshold  Contrast 


A  key  assumption  of  the  visibility  model  is  that  there  is  a  aitical  minimum 
threshold  of  ATg  that  can  be  recognized;  either  by  an  ATR  device  or  a  human  observer.  If 
the  expression  in  Eq.  2.19  is  evaluated  in  the  low  frequency  limit,  the  threshold  output 
contrast,  AT^^.,  and  the  corresponding  input  temperature  difference,  AT^^,  can  be  found: 
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AT,e  =  AT,i„  •  a(f,  =  0) 


(2.20) 


This  represents  the  minimum  degraded  contrast  in  the  output  signal  that  can  be  resolved. 
The  bar  pattern,  in  the  low  frequency  limit,  is  treated  as  a  step  frmction.  The  great 
advantage  of  the  visibility  model  is  that  the  threshold  ouq)ut  contrast  does  not  make  any 
assumptions  about  the  observer.  A  given  system  could  have  one  threshold  value  for  a 
human  observer,  and  another  for  an  ATR  device.  The  visibility  model,  then,  could  be 
useful  in  the  formulation  of  an  objective  measure  that  replaces  the  MRTD.  A  heuristic 
treatment  for  finding  the  critical  temperature,  AT^c,  is  presented  in  the  visibility  model.  The 
proposed  expression  is: 

AT^  =  SNR„NETd[^^]"  (2.21, 

where  Afi^j  effectively  adjusts  the  bandwidth  used  in  the  NETD  to  a  true  system 
bandwidth  rather  than  a  bandwidth  based  on  a  reference  filter  [Ref.  9,  Eq.  7].  The  true 
system  bandwidth  is  given  by: 

oo 

AfTOT  =  df  (2.22) 

0 

where  the  MTF’s  that  determine  the  true  system  bandwidth  are  all  of  the  post-detector  sub¬ 
system  MTF’s.  This  formulation  could  include  a  mcxe  detailed  or  a  greater  number  of  sub¬ 
system  MIT’s,  but  this  would  not  affect  the  salient  features  of  the  visibility  model.  This 
parameter  could  likewise  be  determined  by  direct  measurement  using  a  human  or  ATR 
observer. 

4.  VisibiUty  Model  MRTD 

The  spatial  frequency  dependent  MRTD  curve  is  easily  obtained  for  the  visibility 
model  by  recognizing  that  ATn.h,  used  in  Eq.  2.20  corresponds  to  the  MRTD.  The  MRTD 
is  then  given  by: 
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MRTD(f^)  =  (2.23) 

«(fx) 

The  low  frequency  limit  of  MRTD  now  corresponds  to  the  minimum  threshold  system 
degraded  contrast  observable.  The  only  information  required  to  obtain  the  MRTD  are  the 
ATjc  and  the  a(f-g)  term.  Figure  2. 1  shows  that  the  low  and  high  frequency  trends  for  the 
visibility  model  are  different  from  the  MRTD  prediction  curves  for  the  Ratches  and  Lloyd 
models.  In  these  cases,  the  visibility  model  qjpears  to  correlate  better  with  measured 
laboratory  results  [Ref.  9].  The  MRTD  results  of  the  visibility  model  do  not  go  to  zero  in 
the  low  frequency  limit,  nor  do  they  require  the  addition  of  an  artifrcial  correction  term. 
Since  no  explicit  assumptions  regarding  the  nature  of  the  observer  or  observation  process 
have  been  made,  the  visibility  model  MRTD  formulation  shows  great  potential  as  an 
objective  MRTD  framework.  Likewise,  since  no  explicit  assumptions  are  made  as  to  the 
type  of  TIS  employed,  the  visibility  model  concepts  should  apply  equally  well  to  second 
generation  systems.  The  ^plication  of  these  concepts  to  second  generation  modeling  is 
presented  in  Chapter  V,  following  a  discussion  of  some  other  second  generation  modeling 
concepts. 
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III.  SECOND  GENERATION  MODELING  TOPICS 


The  development  of  second  generation  thermal  imaging  system  technology, 
especially  the  widespread  utilization  of  focal  plane  arrays  (FPA’s)  has  changed  the 
requirements  for  complete  system  modeling.  This  cluq)ter  is  a  review  of  many  of  the 
modeling  artifacts  that  must  be  included  in  order  to  predict  the  performance  of  second 
generation  systems.  The  development  of  these  modeling  concepts  and  the  efforts  to 
quantify  their  effects  represent  the  state  of  the  art  in  thomal  imaging  ^stem  modeling 
development.  The  specific  second  generation  topics  covered  in  detail  include;  three 
dimensional  noise  analysis,  sampling,  aliasing,  sample  scene  phasing,  and  clock-out 
frequency  conversion.  Other  effects  are  discussed  qualitatively  in  the  last  section  of  this 
chapter. 

A.  THREE  DIMENSIONAL  NOISE  EFFECTS 

The  advent  of  the  second  generation  of  thmnal  imaging  systems  has  necessarily 
changed  the  way  noise  is  modeled  in  these  systems.  First  generation  systems  were  typically 
dominated  by  detector  noise.  Detector  noise  was  modeled  as  a  white  noise  process  and 
quantified  by  the  NETD  [Ref.  1].  The  NFTD  is  inadequate  for  modeling  second  generation 
systems  for  a  munbo'  of  reasons  [Refs.  12, 13,  and  14].  As  explained  in  Cluster  I,  the 
NETD  measmement  requires  a  standard  reference  filter  to  simulate  the  post-electronics 
system  processing.  This  is  not  {^plicable  to  second  generation  systems  in  which  data  from 
the  detectors  may  be  already  digitally  processed  to  some  degree  i»ior  to  this  measurement 
point.  The  single-pole  reference  filter  characteristic  is  also  not  rejx’esentative  of  the  multi¬ 
pole,  high  Q-factor  filtering  charactoistics  of  actual  systems.  Another  reason  for  the 
inadequacy  of  the  NETD  is  the  presence  of  significant  directional  noise  components  in 
second  generation  systems.  These  directional  noise  components  exhibit  noise  patterns  in 
the  displayed  imagery,  and  may  overshadow  the  effects  of  simple  detector  noise.  The 
directional  noise  components  arise  from  such  diverse  sources  as  signal  processing,  focal 
plane  non-uniformities,  1^  noise,  and  other  ‘fixed-pattern’  defects  in  the  imaging  system. 
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These  additional  noise  factors  can  be  temporal  or  spatial  in  nature,  and  typically  represent 
recurrent  noise  phenomena  that  cause  fixed  patterns  of  degradation  in  the  displayed  image. 
The  frequency  spectra  of  the  directional  noise  components  have,  typically,  predominantly 
low  frequency  characteristics  whose  effect  is  to  change  the  nature  of  the  total  system  noise 
from  a  white  gaussian  expectation  to  a  highly  directional  characteristic.  This  modified 
system  noise  can  no  longer  be  neatly  characterized  by  a  single  parameter  such  as  NETD. 
Directionality  of  noise  was  not  as  obvious  in  first  generation  systems,  where  emphasis  was 
placed  on  quantifying  temporal  white  detector  noise  [Ref.  13].  In  second  generation 
systems,  however,  these  fixed-pattern  type  noise  sources  are  present  and  their  effect  on  the 
ouq)ut  spectrum  cannot  be  ignored. 

A  three  dimensional  noise  model  using  a  directionally  dependent  coordinate 
system  has  been  developed  by  the  U.S.  Army  Night  Vision  and  Electronic  Sensors 
Directorate  (NVESD)  [Refs.  13  through  16].  In  this  new  methodology,  the  total  noise 
present  is  analyzed  in  terms  of  eight  components,  corresponding  to  the  directional 
combinations  defined  by  the  three-dimensional  (3-D)  coordinate  system.  Hgure  3.1 


depicts  the  composite  data  set,  and  the  directional  axes.  Each  successive  frame  contains 
the  individual  output  signal  of  each  element  in  the  rows  and  columns  of  the  detector  array 
for  that  frame. 


Figure  3.1.  Three  oimensional  noise  directional  coordinate  axes 


The  three  dimensional  noise  analysis  coordinate  system  includes  temporal, 
horizontal,  and  vertical  axes  to  represent  directional  noise  phenomena.  Noise  types  are 
characterized  by  directional  subscripts  (t,v,  and  h)  corresponding  to  temporal,  vertical  and 
horizontal  directions,  or  combinations  of  these.  The  directional  noise  components  are 
considered  to  be  ergodic,  and  each  has  zero  mean  [Refs.  13  and  14].  Their  statistical 
independence  allows  the  characterization  of  each  type  of  noise  from  a  composite  set  of 
sequential  digitized  ouq>ut  frames  of  the  imaging  system.  The  frames  consist  of  the  global 
average  (output  signal  corresponding  to  the  scene),  plus  the  effects  of  the  seven  directional 
noise  types.  The  total  magnitude  of  one  frame  of  the  detector  ouq>ut  composite  data  set  can 
be  represented  by: 

U(t,v,h)  =  S  +  Nj  +  N^  +  Nh  +  Njh  +  Nt^  +  N^h  +  Ntvh.  (3-1) 
where  S  is  the  global  average  (signal),  and  N  represents  the  noise  component  in  the 
subscripted  direction.  For  example,  Nj  represents  ‘frame-to-frame’  noise  that  varies 
between  successive  frames,  but  is  not  correlated  in  the  vertical  or  horizontal  directions. 
Another  example  is  Nyj,  which  represents  pixel  non-uniformities  in  an  array.  These  pixel 
imiformities  cause  spurious  ouq>uts  from  individual  "bad’  pixels,  indq>endent  of  their  row 
or  column  affiliated  trends,  and  independent  of  time. 

The  noise  quantization  process  uses  a  directional  av^aging  image  processing 
technique  on  the  rows,  columns,  and  frames  of  the  composite  d«ta  set  to  determine  the 
statistical  characteristics  of  the  noise  as  measured  in  the  various  directions  dptfinad  by  the 
cotH'dinate  system.  The  ergodicity  of  directional  noise  components  allows  each  directional 
component  to  be  isolated  from  the  others  as  the  directional  statistics  are  measured.  A 
complete  discussion  of  the  directional  noise  averaging  process  is  contained  in  Ref.  14. 
After  the  statistical  processing  of  the  composite  data  set  is  complete,  each  noise  type  is 
characterized  by  its  standard  deviation  about  a  mean  of  zero.  The  characteristic  standard 
deviations  are  used  to  determine  directional  noise  correction  factms  that  incorporate  these 
second  generation  noise  effects  into  the  predictive  model  for  the  MRTD. 


The  3-D  noise  components  are  described  in  Table  3.1,  where  each  noise  component 
is  represented  by  its  standard  deviation,  a,  with  the  appropriate  subscripts.  TTie  seven  types 

TABLE  3.1.  3-D  Noise  Components 


noise 

component 

description 

source 

^tvh 

temporal  pixel  noise 

shot  and  thermal  noise 

fixed  pixel  noise 

pixel  non-uniformity 

temporal  row  noise 

readout  line  processing 

Oy 

row  noise 

Ime  to  line  non-uniformity 

^th 

temporal  column  noise 

readout  column  processing 

column  noise 

columnar  non-uniformity 

firame-to-frame  noise 

firame  bounce 

of  directional  noise  are  most  usefully  described  in  terms  of  their  underlying  phenomena 
[Ref.  12].  Temporal  pixel  noise  is  that  white  detector  noise  caused  by  random  temporal 
fluctuations  of  detector  ou^ut  about  a  mean  of  zero.  This  was  the  only  noise  component 
considered  in  first  generation  models,  and  is  an  unavoidable  consequence  of  the  photon 
arrival  and  current  flow  processes  (Johnson  and  Shot  noise).  The  object  of  good  TIS  design 
is  to  reduce  all  other  noise  components  so  that  this  imavoidable  noise  is  all  that  remains. 
Row,  column,  and  fixed  pixel  noise  are  the  three  temporally  independent  noise 
components.  They  arise  from  detector  non-uniformities  in  the  vertical,  horizontal,  and  two- 
dimensional  directions.  The  source  of  these  non-uniformities  can  be  a  lack  of  precision  in 
offset,  gain,  or  manufacture  of  the  individual  detector  elements  that  make  up  an  array. 
These  noise  types,  although  variant  along  the  rows  and  columns  of  the  composite  data  set, 
are  consistent  from  frame  to  frame.  This  is  often  referred  to  as  ‘fixed  pattern’  noise, 
because  there  is  a  fixed  pattern  of  degradation  in  the  displayed  image.  For  example,  a 
particular  row  may  be  consistently  ‘brighter’,  on  average,  than  its  neighbor  rows,  causing 
a  fixed  pattern  of  degradation  that  doesn’t  depend  on  the  particular  column  or  frame  in  the 


42 


composite  data  set.  The  temporally  variant  noise  components,  temporal  row  noise, 
temporal  column  noise,  and  frame-to-frame  noise,  are  most  prevalent  in  scanning  type 
systems.  This  noise  component  can  arise  from  low  frequency  or  1/f  noise  in  the  offret  level 
of  the  combined  detector  ouq>uts.  These  temporal  types  of  noise  may  also  be  present  for  a 
slowly  changing  scene.  The  temporal  noise  components  can  usually  be  reduced  or 
eliminated  by  good  design. 

Because  of  the  ergodicity  assumption,  the  total  system  noise  standard  deviation  can 
be  written  as  the  root  sum  square  of  the  noise  components  [Ref.  15]: 


2  ,0.5 


«^total  =  +  ^tb  +  C^vh  +  C^tvh) 


(3.2) 


Once  the  directional  noise  components  have  been  determined  for  a  particular 
imaging  system,  they  can  be  used  to  modify  the  prediction  of  MRTD  from  that  based  on 
temporal  pixel  noise  alone  (as  was  done  in  first  generation  models).  The  total  system  noise 
contains  all  the  random  noise  effects  that  will  degrade  imaging  system  performance.  The 
ergodicity  assumption  implies  that  horizontal  MRTD  (bars  oriented  vertically,  but  spaced 
horizontally)  and  vertical  MRTD  (vice-versa)  measurements  are  only  degraded  by  noise 
components  that  contain  that  direction.  For  example,  horizontal  MRTD  prediction  will 
include  spatial  column  noise,  but  not  spatial  row  noise.  [Ref.  13] 

Each  of  the  directional  coordinate  axes  has  unique  ey^rain  integration  factors,  E^, 


Ey,  or  E^.  These  factors  are  model  specific,  and  describe  the  way  the  eyeybrain  process  acts 
on  the  signal  and  noise  in  the  given  direction.  These  eye/brain  integration  effects  are 
analogous  to  the  SNR  enhancing  ‘perception  factors’  cited  by  Lloyd  [Ref.  3,  Chapter  5]. 
They  differ  from  model  to  model,  and  depend  to  a  great  extent  on  the  method  used  to  model 
die  eye/brain  process.  Each  integration  factor  will  tend  to  increase  or  decrease  the  signal 
to  directional  noise  ratio  when  the  noise  component  direction  and  integration  direction 
coincide.  When  the  noise  and  integration  effects  are  ^plied  to  each  of  the  horizontal  and 
vertical  directions,  the  appropriate  composite  noise  terms  can  be  described  by: 
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(3.3) 


Qj  =  (a^|,E,E.(f)E|,(f)  +  a;i,E,(f)E^(f)  +  ai'i,E,E^(f)  +  ajEfc(f))‘''* 


and, 

T  -3  '3  2  0-5 

Q.  =  (o^HE,E„(f)E|,(f)+a;HE.(f)Ej(f)  +  CT^E,E.(f)  +  a,E,(f)) 

(3.4) 

The  composite  system  noise  terms  are  then  used  to  calculate  MRTD  noise  correction 
factors,  that  modify  the  original  formulation  of  NETD  to  include  all  3-D  noise  components. 
The  analysis  usually  infers  an  initial  representation  of  MRTD  in  the  form: 

MRTD^  =  C3  X  NETD  X  k^(f^) ,  (3.5) 

where  the  ‘z’  subscript  refers  to  either  the  horizontal  or  vertical  direction  as  appropriate. 
‘Cg’  is  a  frequency  dependent  numerical  constant  that  includes  the  MTF  characteristics  of 
the  system,  NETD  is  the  first  generation  noise  factor  due  to  temporal  pixel  noise  only,  and 
is  the  iqjpropriate  directional  correction  factor  calculated  according  to  the  second 
generation  model  used.  The  formulation  of  all  three  of  the  terms  appearing  on  the  right 
hand  side  of  Eq.  3.5  will  differ  according  to  the  unique  aspects  of  the  second  generation 
model  employed.  To  illustrate  the  concept,  the  3-D  noise  formulation  used  in  the  FLIR92 
model  is  presented  in  the  next  section. 

The  3-D  noise  analysis  is  a  step  forward  from  simple  first  generation  modeling 
methods.  It  has  the  advantage  of  being  measured  from  hard  laboratory  data,  and  more 
accurately  represents  some  of  the  noise  effects  found  in  second  generation  imagers. 
However,  although  the  methodology  is  easily  incoiporated  into  a  wide  variety  of  models, 
the  physical  difficulties  realized  in  actually  quantifying  the  individual  directional  noise 
components  limits  the  implementation  of  a  3-D  noise  analysis  in  some  ^plications. 
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B.  3-D  NOISE  IN  FLIR92 


The  FLIR92  model  produced  by  the  NVESD  has  become  the  de  facto  standard  in 
second  generation  modeling.  A  complete  discussion  of  the  FLIR92  model  is  appropriate 
to  this  document  for  completeness,  and  has  been  included  as  ^pendix  C.  This  section  will 
focus  on  the  way  FLIR92  implements  a  3-D  noise  analysis  as  an  illustration  of  the  topics 
presented  in  the  preceding  section.  The  ideas  and  equations  of  this  section  are  ad^tations 
of  those  found  in  the  original  FLIR92  documentation  [Refs.  13  through  16]. 

The  updated  treatment  of  noise  to  include  3-D  noise  concepts  is  one  of  the  new 
features  of  the  FLIR92  model.  Recall  that  the  total  3-D  noise  standard  deviation  was 
expressed  in  terms  of  the  standard  deviations  along  the  combinations  of  temporal,  vertical, 
and  horizontal  directions  as: 


.  2  2  2  2  2  2  2  .0.5 

^total  “  ^tv  ^th  **"  ^tvh'  » 


(3.6) 


where  the  noise  descriptions  are  the  same  as  those  presented  in  Table  3.1. 

In  FLIR92,  the  modeling  of  each  of  the  seven  noise  components  is  implemented  by 
either  scaling  each  of  the  noise  components  to  a^yh.  or  by  inputting  actual  measured  values. 
Currently,  o^vh  is  the  only  noise  component  that  can  be  predicted  from  system  parameters. 
The  value  for  ajyt  is  calculated  in  a  manner  similar  to  the  method  used  by  first  generation 
models  to  calculate  the  NETD.  FLIR92,  however,  calculates  a^yi,  based  on  the  actual 
bandwidth  of  the  system,  not  the  artificial  reference  bandwidth  used  by  NETD.  The  value 
for  ajyhisgivenby: 


^tvh 


=  NETDX 


*l^^sys 

vs; 


(3.7) 


where  is  the  noise  bandwidth  for  the  NETD  calculation,  and  Afjyj  is  the  actual 
bandwidth  of  the  system.  FLIR92  uses  the  calculated  value  of  a^yii,  the  formulation  of  the 
system  MTF  (Appendix  C),  a  directional  noise  COTrection  factor,  and  ey^rain  spatial  and 
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temporal  integration  factors  to  calculate  the  predicted  MRTD.  The  FLER92  MRTD 
formulation  matches  the  general  form  given  in  Eq.  3.5,  and  is  given  by: 


MRTD  ff  )  = 


Hsys(fz) 


[EtEh(fz)E,(f,)] 


05 


(3.8) 


V  J 

Recall  the  ‘z’  subscript  implies  that  the  variable  is  to  be  evaluated  in  either  the  horizontal 
or  vertical  direction  as  appropriate.  Most  of  the  terms  in  Eq.  3.8  can  be  recognized  as 
‘carry-overs’  from  the  original  Ratches  MRTD  formulation,  given  as  Eq.  2.8.  The 
remaining  terms  are  calculated  by  PTJR92  in  the  manner  described  below.  For 
convenience,  the  MRTD  parameters  are  summarized  in  the  Table  3.2. 


TABLE  3.2.  MRTD  equation  parameters 


parameter 

description 

SNRjjjj. 

threshold  SNR  for  resolution 

^tvh 

random  ’  pixel  noise 

3-D  noise  correction  factor 

^ys 

system  MTF  as  described  in  Appendix  C 

Ez 

directional  eye/brain  integration  factor 

Although  Eq.  3.8  appears  complex,  it  is  most  easily  interpreted  as  a  modification  of  noise 
temperature  by  system  parameters  and  psycho-physical  effects  to  give  an  MRTD.  The  only 
term  with  units  is  the  term,  given  in  degrees  Celsius.  The  remainder  of  the  terms  are 
dimensionless  factors  that  either  increase  or  decrease  this  ‘temperature’  as  a  function  of 
target  spatial  frequency.  The  numerical  constant,  threshold  SNR,  and  system  MTF,  are 
defined  as  they  were  for  first  generation  models.  ITJR92  recommends  a  value  of  2.5  as  a 
reasonable  average  value  for  threshold  SNR,  and  an  eye  integration  time  of  0. 1  sec.  Recall 
that  the  ajvji  term  represents  temporal  pixel  noise,  like  the  NETD  term  of  the  1975  model, 
but  modified  by  the  system  bandwidth.  In  general  form,  it  is  given  by: 
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^tvh  - 


sys 


(3.9) 


nx„7^|  jD’(A.,300)|^(X)dX 


The  3-D  directional  noise  components  enter  the  equation  via  the  k^Cfs)  term.  This 
term  includes  the  seven  3-D  noise  components  to  the  extent  they  are  q^plicable  to  the  type 
of  system  being  modeled.  The  term  is  derived  from  the  general  noise  term  forms  given  as 
Eq.  3.3  and  Eq.  3.4.  The  term  and  the  eye/brain  integration  terms  appear  explicitly  in 

the  MRTD  equation  Eq.  3.8,  so  these  terms  are  divided  out  of  the  correction  factms.  The 
resulting  horizontal  and  vertical  correction  factors  are  given  by; 


= 


1-1- 


'vh 


2 


>0.5 


^?vhEv,(fx)  ^whEtEy  (fx)J 


(3.10) 


and. 
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1  + 


\h 
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th 


CT,. 


OBhE,  oLEl.,(fy) 


OJ 


(3.11) 


Each  directional  correction  factor  (vertical  or  horizontal)  contains  the  noise  components 
and  integration  factors  appropriate  to  it.  (Recall  that  by  popular  convention  the  ‘x’ 
subscript  is  used  for  horizontal  parametm  and  the  "y’  subscript  is  used  for  vertical 
parameters.) 

The  final  terms  of  the  MRTD  formulation  that  require  elaboration  are  the  spatial 
and  temporal  integration  factors  themselves.  For  staring  second  generation  imagers,  there 
are  five  eye/brain  integration  factors  required.  The  factors  are  desoibed  in  Table  3.3.  Their 
formulation  in  ETJR92  is  given  by  the  equations  that  follow. 
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TABLE  3.3.  Eye/brain  integration  factors 


Factor 

Description 

Et 

eye/brain  temporal  integration 

Evv 

eye/brain  vertical  integration,  vertical  direction 

eye/brain  horizontal  integration,  horizontal  direction 

Eyh 

eye/brain  vertical  integration,  horizontal  direction 

eye/brain  horizontal  integration,  vertical  direction 

The  eye/brain  temporal  integration  factor  is  given  as; 


Et  = 


a, 


Edot^e 


(3.12) 


where  cx^  is  a  frame  to  frame  correlation  factor,  usually  set  to  one.  This  tempioral  integration 
factor  is  identical  to  that  given  by  Lloyd  [Ref.  3,  Chapter  5]. 

The  spatial  directional  integration  factors  used  in  FLIR92  are  more  complex,  and 
attempt  to  model  the  eye/brain  integration  along  the  bars  in  both  directions.  They  are  given 
in  the  FLIR92  reference  guide  [Ref.  16]  as: 


and. 


(3.13) 


(3.14) 
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where  the  z  term  indicates  the  direction  perpendicular  to  z  (e.g.,  ‘y’  in  the  case  of  horizontal 
where  z=x).  The  term  is  a  system  noise  filter  MTF  given  in  Appendix  C.  An 
approximate  form  of  these  integration  factors  is  given; 


Eh(f.) = 


(3.15) 


and. 


where  and  Oy,  the  horizontal  and  vertical  correlation  factors,  are  usually  set  to  one;  and 
and  spatial  sampling  rates  (samples/mrad)  and  bar  target  long  dimension 

(cyclesAnrad)  respectively  [Ref.  15].  These  can  be  shown  to  be  analogous  to  Lloyd’s 
vertical  integration  ‘perception  factor’  described  for  first  generation  htxrizontal  MRTD. 

The  FL1R92  model  calculates  a  separate  value  for  MRTE)i|  and  MRTDy.  The 
implied  ergodicity  of  the  two  allows  the  geometric  mean  of  the  horizontal  and  vertical 
MRTD  values  to  give  a  2-D  MRTD  value.  Sample  ou^uts  from  the  FL1R92  program  are 
contained  in  Appendix  C. 

C.  SAMPLING  AND  ALIASING 

The  3-D  noise  analysis  presented  in  Section  A  is  based  on  a  linear  MTP  analysis  of 
a  given  system.  This  linear  degradation  that  occurs  in  the  reconstruction  of  an  image 
because  of  the  filtering  out  of  high  spatial  frequency  components  of  the  target  scene  is 
referred  to  as  ‘blurring’  [Ref.  17].  This  problem  is  adequately  e}q)lained  in  terms  of  the 
generally  low-pass  nature  of  the  system  MTF,  and  linear  systems  theory.  There  are  other 
noise  effects  which  cannot  be  qipropiiately  modeled  using  linear  systems  theory.  In 
particular,  the  problem  of  representing  a  sampled  imaging  system  and  aliasing  effects 
caused  by  undersampling  cannot  be  modeled  by  the  conventional  concept  of  an  OTF. 
Sampling  is  inherent  to  almost  all  real  imaging  systems,  and  can  occur  in  several 
dimensions  due  to  scanning,  multiplexing,  digitization,  or  the  finite  discrete  nature  of  the 
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detector  elements  and  the  detector  array  geometry.  This  second  type  of  image  degradation, 
caused  by  the  masking  of  spatial  detail  by  the  ‘folding  over’  of  high  frequency  components 
into  the  pass  band  of  the  system  by  xmdersampling,  is  referred  to  as  ‘aliasing’  [Ref.  17]. 
Aliasing  occurs  in  sampled  imaging  systems  when  the  sampling  frequency  is  below  the 
Nyquist  rate  for  the  highest  spatial  frequency  content  in  the  imaged  scene.  This  situation 
violates  the  premises  of  isoplanatism  and  linearity  that  allow  the  application  of  linear 
systems  theory  to  ‘blurring’  type  noise  [Ref.  4].  Specifically,  an  input  at  a  high  frequency 
can  cause  a  spurious  output  at  a  lower  spatial  frequency  if  the  system  is  undersampled. 
Also,  the  response  of  the  detector  array  is  not  spatially  invariant,  as  it  depends  on  where  the 
image  falls  on  the  detector  plane  in  relation  to  the  active  area  of  the  detector  elements  and 
the  dead  space  between  them.  Sampling  is  an  unavoidable  consequence,  even  in  first 
generation  TIS,  but  its  effects  were  largely  ignored  in  first  generation  modeling. 
Subsequent  to  the  development  of  first  generation  models,  considerable  effort  was 
expended  on  quantifying  the  effects  of  sampling  and  aliasing  on  displayed  imagery  [Refs. 
17  through  22].  In  the  study  of  sampling  and  aliasing  effects  and  their  effect  on  displayed 
imagery,  it  has  been  found  that  most  significant  aliasing  effects  are  caused  by  the  ffnite 
active  area  and  spacing  of  the  detector  elements  in  an  array  [Ref.  18].  Other  sampling 
artifacts  certainly  exist  in  the  spatial  and  temporal  domains,  but  these  may  be  eliminated  or 
reduced  through  proper  system  design.  By  convention,  rectangular  geometry  for  detector 
elements  is  usually  assumed  for  the  analysis  of  aliasing  effects.  This  is  the  most  common 
geometry  encountered  because  it  is  the  most  practical  for  FPA  construction.  Other  detector 
geometries  are  in  use,  and  may  be  substituted  as  required.  Figure  3.2  portrays  the  salient 
features  of  the  spatial  sampling  process  defined  by  the  detectors. 
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dl  Detector  active  area 
Dead  Space 


Figure  3.2.  Spatial  sampling  by  a  rectangular  detector  array 
The  spatial  sampling  pmod  in  mrad  is  given  by: 

Am  + As 


A  = 


^ocal 


(3.17) 


where  fo^ai  is  the  focal  length  of  the  system  optics.  The  sampling  frequency  is  defined  as: 


f  =  - 
^  A 


(3.18) 


Because  of  the  sampling  process,  there  is  a  characteristic  maximum  frequency 
above  which  the  system  will  no  longer  rqjroduce  input  frequencies  accurately.  The 
limiting  spatial  frequency  for  undersampled  systems  is  the  Nyquist  frequency  of  the  signal 
[Ref.  25].  This  represents  the  highest  spatial  frequency  content  of  the  scene  that  can  be 
reproduced  without  alia.<iing, 


f  -L* 
%  -  2* 


(3.19) 


Staring  systems  are  usually  imdersampled  because  of  the  small  dimpnsinn  of  the 
FPA.  The  characteristic  maximum  frequency  is  based  on  the  center  to  center  spacing  or 
‘pitch’  and  the  size  of  the  detector  elements  as  shown  in  Fig.  3.2.  For  square  detectors  with 
equal  pitch  in  both  horizontal  and  vertical  directions,  this  frequency  is  the  same  in  both 
directions. 
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The  fact  that  aliasing  is  predominantly  a  high  frequency  phenomenon  suggests  that 
aliasing  may  not  be  significant  for  natural  scenes  of  a  generally  qjeriodic  nature.  However, 
while  it  is  true  that  aliasing  effects  are  most  readily  apparent  for  high  frequency  periodic 
images,  it  is  not  true  that  natural  aperiodic  scenes  do  not  suffer  from  significant  image 
degradation  as  well.  Aliasing  present  in  aperiodic  scenes  may  not  be  recognized  as  such  in 
the  presence  of  3-D  noise,  because  it  is  indistinguishable  from  other  types  of  noise  in  the 
final  image  displayed.  Thus,  for  the  puiposes  of  TIS  modeling,  aliasing  is  often  treated  as 
signal  dependent  additive  noise.  [Ref.  18] 

The  spatial  domain  description  of  the  sampling  process  is  shown  in  Fig.  3.3. 


Figure  3.3.  Spatial  domain  sampling  process,  after  Ref.  18 


In  Fig.  3.3,  the  effects  of  the  entire  thermal  imagmg  system  are  broken  down  into 
three  components.  The  input  spatial  target  scene  is  described  by  a  band-lhnited  two 
dimensional  spatial  pattern,  s(x,y),  representing  the  projection  of  the  scene  onto  the 
detector  array,  free  of  any  degradation.  All  filtering  effects  up  to  and  including  the  detector 
are  lumped  together  in  an  ‘image  formation’  point  spread  function,  hj(x,y).  This  is 
followed  by  a  sampling  function,  and  an  ‘image  reconstruction’  point  spread  function, 
h^x,y),  which  includes  all  post-detector  electronic  and  display  effects.  The  imaging 
process  can  be  described  mathematically  as  a  convolution/multiplication; 

i(x,y)  =  [(s(x,  y)0hi(x,y))xp(x,y)]0h,(x,y)  .  (3.20) 

The  application  of  the  Fourier  transform  allows  a  convenient  description  of  the 
process.  Figure  3.4  shows  the  process  in  the  transformed  domain.  Note  the  convolutions 
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are  rq>laced  by  multiplication  and  the  sampling  process  has  become  a  convolution.  This  is 
identical  to  the  separation  of  the  averaging  and  sampling  process  described  in  Chapter  I. 


Figure  3.4.  Spatial  frequency  domain  representation,  after  Ref.  18 
The  input  scene  is  now  represented  by  the  complex-valued  Fourier  transform,  S(fx,fy).  The 
target  transform  will  typically  be  band-limited  and  symmetric  for  real  target  scenes.  The 


ouq)ut  transform  is  now  given  by: 

l(f^,  fy)  =  [(S(f^,  fy)  X  Hi(f,,  fy))  0  P(f^,  fy)]  X  H,(  f ,,  fy)  0.21) 

where  both  and  Hj.  will  be  the  two  dimensional  cascaded  MTF’s  both  covering  the 
horizontal  and  vertical  dimensions.  These  cascaded  functions  will  typically  be  Gaussian  as 
described  by  the  central  limit  theorem  of  probability  [Ref.  6] .  The  interesting  effect  comes 
from  the  sampling  term.  In  the  spatial  frequency  domain,  this  process  is  represented  by  a 
two  dimensional  array  of  sampling  delta  functions,  spaced  at  integer  multiples  of  the 
sampling  frequency.  If  an  infinite  array  of  sampling  delta  functions  is  assumed,  the 
sampling  transfer  function  can  be  represented  as  an  infinite  series  of  delta  functions: 

oo  oo 

P(f^,  fy)  =  ££6(f,  -  kf3)6(fy  -  kf,)  .  (3.22) 

...oe  ^oo 

For  real  imaging  systems,  the  sampling  array  is  not  infrnite.  This  will  cause  the  spreading 
of  the  individual  frequency  domain  delta  functions  by  the  fouiier  transfrum  of  the  detector 
shape  (they  are  no  longer  strictly  delta  functions).  The  sampling  MTF  is  convolved  with 
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the  image  transform  and  the  image  formation  MTF.  the  result  is  a  periodic  repetition  of  the 
filtered  image  in  the  frequency  domain,  at  intervals  corresponding  to  the  sampling 
frequency  of  the  array.  This  is  depicted  in  one  dimension  as  Fig.  3.5,  where  fj.  is  the  highest 
spatial  frequency  present  in  the  filtered  image. 


If  the  system  is  undersampled,  i.e.  f^  <  2f^,  there  will  be  an  overlap  in  the  resultant 
spectra.  This  overlap  will  exist  in  both  the  horizontal  and  vertical  spatial  frequency 
directions,  and  is  the  source  of  aliasing.  The  output  spectrum  is  no  longer  linear  because  a 
frequency  input  near  the  cutoff  is  no  longer  faithfully  reproduced.  Frequencies  above  the 
cutoff  have  been  ‘folded  over’  onto  the  original  spectrum  due  to  undersampling.  This 
periodic  spectrum  is  then  filtered  by  the  reconstruction  filter.  Figure  3.6  portrays  the 
frequency  domain  effect  of  the  image  reconstruction  filtering  of  the  image  for  a  case  where 
the  reconstruction  filter  has  a  greater  bandwidth  than  the  image  formation  filter. 
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Figure  3.6.  Application  of  a  wide  bandwidth  reconstruction  filter 
The  product  of  the  two  functions  will  contain  a  vestige  of  the  overlapping  portion  of  the 
filtered  image  spectrum,  as  appears  in  Fig.  3.7. 


Figure  3.7.  Resulting  spectrum  with  aliased  component 
The  vestige  of  the  overlt^  will  survive  the  image  reconstruction  filtering,  and  will  have  a 
spurious  high  frequency  aliasing  effect  when  the  spectrum  of  Fig.  3.7  is  inverse 
transformed  back  into  the  spatial  domain.  This  spurious  high  frequency  term  rjin  be  treated 
as  additive  noise  [Ref .  18].  Figure  3.7  suggests  that  the  output  spectrum  can  be  divided 
into  two  components.  The  image  spectrum  is  represented  as; 

fy)  =  Icorrect(fx.  ^y)  +  A(f^,  fy)  (3.23) 


55 


where  Iconect'  ‘good’  part  of  the  spectrum  that  represents  the  properly  filtered  (no 
aliasing)  output  spectrum,  is  given  by: 

Icorrecl  =  S(f„  fj.) ;  (3.24) 

and  the  aliasing  term,  defined  as  the  spurious  response  due  to  the  vestige  of  the  overlapping 
spectra,  is  given  by 


A(f^,  fy)  = 


E 


£  S(f^  -  nf3^,  fy  -  mf3y)Hi(4  -  nf3^,  fy  -  mf3y) 


X  H,(f,,  fy) 


*"11=^0111  ^0 


(3-25) 

The  second  term  has  an  obvious  negative  impact  on  image  quality.  As  Fig.  3.6  implies, 
the  most  significant  aliasing  terms  are  those  immediately  adjacent  to  the  original  spectrum 
and  the  nearest  cross-terms  (i.e.,  combinations  of  A(nf3j,mfy)  where  m=- 1,0,1  and  n=- 1,0,1) 
These  immediately  adjacent  terms  are  the  only  ones  included  in  the  VISMODII  model 
presented  in  Chapter  V.  If  the  inverse  Fourier  transform  of  Eq.  3.23  is  taken,  the  resulting 
form  motivates  the  representation  of  aliasing  as  additive  noise; 

i(x,y)  =  icorrect(*’y)  +  a(*’y)  •  (3-26) 

It  is  important  to  note  that  the  aliasing  term  contains  all  frequencies  that  are  effected  by  the 
overlapping  spectra.  The  correct  image  output  corresponds  to  the  prop)erly  filtered  image 
ignoring  the  sampling.  The  aliased  component  represents  a  ‘correction’  factor  that  must  be 
added  to  the  correct  image  in  order  to  match  the  image  actually  displsyed.  If  this  COTrection 
factor  is  interpreted  as  noise,  then  it  is  both  additive  and  scene  dependent  [Ref.  18].  The 
effects  of  this  aliasing  noise  have  been  studied  in  the  context  of  TV  and  motion  picture 
images  for  many  years  [Ref.  19] .  The  application  of  this  effect  to  TIS  modeling  is  a  natural 
extension,  and  has  been  shown  to  have  a  measurable  impact  on  MRTD  [Ref.  20] .  In  fact, 
in  some  scenarios,  aliasing  effects  may  be  considerably  more  degrading  than  spatial  noise 
effects  [Ref.  17]. 
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Several  approaches  have  been  presented  to  minimize  the  ejects  of  aliasing.  One 
method  that  is  suggested  by  Fig.  3.6  is  the  trade-off  incurred  in  the  design  of  the 
reconstruction  filter.  If  the  bandwidth  of  the  reconstruction  filter  is  decreased,  less  of  the 
sideband  of  the  overlapping  second  poiodic  image  is  allowed  into  the  final  ou^ut 
spectrum.  Unfortunately,  this  has  the  obvious  negative  effect  of  filtering  out  some  of  the 
high  frequency  detail  of  the  original  image  as  well  [Ref.  18].  Another  method  involves  the 
proper  processing  of  the  reconstructed  image  by  certain  digital  signal  processing 
techniques  to  remove  the  spurious  component  [Ref.  21].  Still  a  third  method  is  the  careful 
control  of  the  shape  of  the  detector  element  and  the  resulting  image  formation  filter  [Ref. 
17].  The  use  of  microscanned  imagery  is  anoth^  method  to  reduce  aliasing  efiects  by 
effectively  increasing  the  sampling  frequency.  In  this  method,  the  image  is  shifted  around 
on  the  detector  plane  in  half  detector-sized  increments.  This  process  increases  the  effective 
sampling  frequency,  thus  it  is  less  susceptible  to  aliasing  and  sample  scene  phasing  [Ref. 
22]. 

Proper  design  to  eliminate  or  reduce  the  effects  of  aliasing  is  certainly  desirable,  but 
the  challenge  of  incorporating  aliasing  effects  into  TIS  MRTD  prediction  models  remains. 
Most  current  models  deal  with  the  modeling  difficulties  by  ignoring  aliasing  entirely. 
Others  do  not  provide  ouqjuts  for  frequencies  above  the  Nyquist  frequency.  Neither 
fq>proach  is  optimal,  indicating  that  further  work  is  required  in  this  area.  The  second 
generation  visibility  model,  VISMODII,  incorporates  the  aliasing  effect  as  part  of  a 
contrast  transference  parameter,  as  will  be  discussed  in  Ch^ter  IV. 

D.  SAMPLE  SCENE  PHASING  EFFECTS 

Because  scene  phasing  effects  and  aliasing  effects  are  inextricably  linked,  they 
must  be  considered  together.  Aliasing,  as  discussed  in  the  previous  section,  arises  from 
undersampling  of  the  target  image  by  the  detects  array.  Scene  phasing  is  a  measurable 
effect  of  displacement  of  the  target  image  from  the  cento*  of  the  detector  elements  on  the 
focal  plane  of  the  imager.  Both  of  these  effects  can  be  significant,  especially  fix 
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undersampled  systems.  A  mathematical  treatment  of  the  process  is  provided  here  to 
demonstrate  the  validity  of  the  aliasing/scene  phasing  characterization  used  in  VISMODII. 

The  sampling  process  can  be  described  as  a  two  dimensional  array  of  delta 
functions  as  shown  in  Fig.  3.8.  Each  delta  function  is  positioned  at  the  center  of  an 
individual  detector  element  in  the  FPA. 

f  I 


(vertical  pitch) 

(horizontal  pitch) 

Figure  3.8.  Two  dimensional  sampling  array 
The  effects  of  scene  phasing  are  felt  in  two  dimensions.  The  mathematical 
discussion  of  this  effect  is  greatly  simplified,  however,  if  reduced  to  one  dimension.  The 
discussion  here  is  given  in  one  dimension  but  is  easily  extended  to  a  two  dimensional 
sampling  array.  In  one  dimension,  the  sampling  array  looks  like  a  line  of  delta  functions 
spaced  by  the  detector  pitch.  If  the  image  to  be  sampled  and  the  sampling  elements  are 
misaligned,  the  effect  may  be  modeled  as  a  spatial  shift  for  the  sampling  array.  This  effect 
is  obviously  most  troublesome  for  severely  imdersampled  systems. 

To  represent  the  detector  plane  image/detector  center  misalignment,  the  sampling 
function  is  displaced  from  the  origin  a  distance  ‘b’  as  shown  in  Fig.  3.9.  The  sampling 
function  is  described  by  the  comb  function; 

oo 

combf^^J  =  ^B(x  -  b  -  nAx)  ,  (3.27) 
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Figure  3.9.  Displaced  sampling  function  in  one  dimpinsinn 
From  Foiuier  theory,  if  the  Fourier  transform  of  a  spatial  function  is  denoted  by; 

3{g(x)}  =  G(f).  (3.28) 

then  the  Fourier  transform  of  the  shifted  function  is  given  by: 

3{g(x-b)}  =  G(f)e•'^”'’^  (3.29) 

Sampling  is  a  spatial  domain  multiplication  process.  In  the  frequency  dowmin  then 
it  requires  the  convolution  of  the  Fourier  transform  of  the  filtered  spectrum  and  the  Fourio- 
transform  of  the  sampling  function  itself.  By  Eq.  3.29,  The  Fourier  transform  of  the  shifted 
train  of  delta  functions  is  given  by; 

3-  comb(^2^J  .  =  comb(^0e^^"‘’^  =  e-'^"'’^£8(f-nf5)  (3-30) 

The  convolution  integral  for  two  functions  u  and  v  may  be  described  as: 

u  ®  V  =  J  ^u(x)v(xo  -  x)dT  (3.31) 

The  frequency  domain  convolution  of  the  filmed  image  spectrum,  S(f),  with  the  Fourier 
transform  of  the  sampling  function  is  then  given  by: 

Sampled  spectrum  =  J  S(v)6(f  -  nfj  -  (3.32) 

Since  the  convolution  of  a  function  with  a  delta  function  is  exactly  that  function  repeated 
at  the  location  of  the  delta  function,  the  output  of  the  integration  gives: 
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Sampled  spectrum  =  S(f-nfj)e  '  (3.33) 

where  n  is  the  order  of  replication,  n=  0,  +l,-l,+2,-2,...  Thus,  the  sampled  spectrum  is  the 
original  filtered  spectrum  repeated  at  integer  multiples  of  the  sampling  frequency,  and 
multiplied  by  an  exponential  due  to  the  original  scene  phasing.  The  sampled  spectrum  is 
illustrated  in  Fig.  3.10. 


The  value  of  ‘b’,  causes  a  periodic  phase  distortion  in  the  output  that  is  zero  whenever  b  is 
zero  or  a  multiple  of  the  detector  pitch.  Intuitively,  the  value  of  b  that  would  cause  the 
greatest  distortion  would  be  exactly  one  half  the  detector  pitch,  corresponding  to  exact 
misalignment  between  the  target  image  and  the  detector  array.  The  effect  of  scene-phasing 
on  MRTD  prediction  wiU  be  explored  in  Cluster  VI. 

E.  CLOCK-OUT  FREQUENCY  CONVERSION  EFFECTS 

In  Chapter  I,  a  simple  equation  relating  the  spatial  and  temporal  frequency  for 
scanning  first  generation  systems  was  presented  as  Eq.  1.8.  In  this  section  it  will  be 
demonstrated  that  this  simple  relationship  does  not  ^ply  to  staring  FPA’s.  This  topic  has 
been  ignored  by  most  second  generation  models.  In  FLIR92,  the  electrical  system  is  not 
considered  to  be  a  limiting  factor  for  FUR  MRTD  performance  [Ref.  16] .  In  fact,  this  effect 
can  be  significant  for  electrically  bandwidth-limited  systems.  An  ATR  device  may  fall  into 
this  category.  As  discussed  in  Chapter  I,  the  electrical  system  components  act  on  a 
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temporal  rather  than  a  spatial  signal.  The  way  in  which  the  detector  FPA  converts  the 
spatial  image  received  into  an  electrical  signal  becomes  an  important  consideration.  For 
first  generation  scanning  systems,  this  was  a  rather  simple  procedure.  In  these  systems,  the 
image  shifted  every  interval  of  the  dwell  time,  and  there  was  a  serial  output  from  the  single 
detector  clocked-out  at  the  same  interval.  In  FPA’s,  however,  the  ‘clock-out’  process  can 
be  more  complicated.  Figure  3.1 1  portrays  two  possible  clock-out  configurations. 
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Figure  3.11.  Two  possible  clock-out  patterns  few  an  FPA 


In  both  clock-out  patterns,  the  dwell  time  for  an  individual  detector  is  the  entire 
frame  period.  If  the  image  is  converted  to  an  analog  video  signal,  then  the  ou^uts  of  the 
detectors  must  be  converted  to  a  serial  analog  signal  based  on  a  clock-out  interval  between 
elements.  Whereas  in  first  generation  systems  the  clock-out  interval  was  equal  to  the  dwell 
time,  in  FPA  systems  the  clock  out  interval  between  adjacent  detector  elemenfs  is  a  more 
complex  fimetion  of  the  clock-out  geometry,  number  of  elements,  and  the  frame  rate.  It  is 
also  seen  from  the  figure  that  the  clock-out  interval  between  horizontally  adjacent  elements 
may  be  different  from  the  clock-out  interval  between  vertically  adjacent  elements. 
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As  an  example,  consider  the  representative  horizontal  clock-out  geometry  depicted 
in  Fig.  3.11.  In  this  typical  case,  the  individual  detector  element  ou4)uts  are  clocked-out 
in  a  sequential  fashion  along  a  row,  with  the  clock-out  then  proceeding  down  to  the  next 
row.  This  can  be  visualized  as  a  reverse  raster  scan  type  process,  where  the  clock-out 
direction  and  the  scan  direction  are  analogous.  To  relate  a  spatial  frequency  in  the  ‘in-scan’ 
direction  (in  this  case  a  row)  to  a  temporal  frequency,  it  is  necessary  to  relate  the  physical 
detector  pitch  (in  mrad)  to  the  scan  time  interval  between  adjacent  detector  elements  in  this 
direction. 

The  number  of  pixels  subtended  by  one  cycle  of  the  bar  pattern  horizontally  on  the 
image  plane  corresponds  to; 


number  horizontal  pixels  =  - 

a 


(3.34) 


The  in-scan  clock-out  interval,  is  a  function  of  the  number  of  detectors  in  the  (n  row 


by  m  column)  array  and  the  frame  rate  given  by: 


(3.35) 


To  determine  the  total  time  it  takes  for  a  complete  cycle  of  the  bar  to  be  clocked  out,  it  is 
necessary  to  multiply  the  number  of  pixels  by  the  clock-out  interval  per  pixel: 


«  Pdot  ■  °  “ 


(3.36) 


The  corresponding  temporal  frequency  is  the  inverse  of  this  quantity: 

^  1  aF^ot-n-m 

f.  =  -  =  - rrrr -  Hz 


(3.37) 


If  the  bar  pattern  fimdamental  spatial  frequency,  fj^,  is  defined  to  be  1/2W  cy/mrad,  then 
relating  the  two  frequencies  gives  the  conversion  factor  for  the  ‘in-scan’  direction: 


f— V 


(3.38) 
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In  the  cross-scan  or  ‘out-scan’  direction,  the  clock-out  time  interval  between 
adjacent  elements  is  increased  by  the  number  of  detectors  in  a  row  (n).  Thus,  tiie  number 
of  vertical  pixels  subtended  by  an  image  in  the  focal  plane  is: 

2W 

number  vertical  pixels  =  -5-  ,  (3.39) 

P 


and  the  clock-out  interval  between  adjacent  detectors  is: 

1 

"^COS  T3  .  n  ’ 

Pdot  “ 

giving  rise  to  the  ‘out-scan’  conversion  factor: 


(3.40) 


(3.41) 


Generalizing  Eqs.  3.38  and  3.41  to  include  systems  diat  may  clock-out  along  the  columns 
instead  of  the  rows,  and  putting  them  in  terms  of  US  parameters,  the  general  form  of  the 
conversion  factors  becomes: 


In  -  scan 


f  =  f 

^in-scan[  f  I 

V  local  ) 


(3.42) 


f  Fdot  •  n  •  Az] 

Cross -scan  f^  =  fcross-scan  — f -  .  (3-43) 

^  *ocal  j 

where  the  in-scan  spatial  frequencies,  detector  pitch,  Az,  and  number  of  elements  refer  to 
either  the  horizontal  or  vertical  direction  as  iq>pr<q>riate  for  the  clock-out  pattern  used. 

This  conversion  is  important  in  determining  the  difference  in  MRTD  predictions  for 
the  horizontal  and  vertical  directions,  especially  fcM-  electronic  bandwidth  limited  systems. 
A  quick  glance  at  Eq.  3.42  and  Eq.  3.43  reveal  that  the  electrical  frequencies  in  the  in-scan 
direction  will  be  greater  by  a  factor  ccaresponding  to  die  number  of  detector  elements  in  an 
in-scan  row  or  column.  This  factor  is  typically  between  128  and  512,  so  the  effect  is 
significant.  Because  the  frequencies  are  higher,  the  electronic  MTF  will  have  a  more 
severe  filtering  efiect  in  the  in-scan  direction.  One  would  eiqiect,  then,  better  MRTD 


63 


results  in  the  cross-scan  direction  than  the  in-scan  direction  for  electrically  bandwidth 
limited  systems  that  use  such  a  clock-out  procedure.  Remember,  the  in-scan  direction  does 
not  refer  to  either  the  horizontal  or  vertical  MRTD  in  particular.  In  some  systems,  the  in¬ 
scan  direction  will  correspond  to  the  horizontal.  In  others,  it  will  correspond  to  the  vertical, 
as  determined  by  the  clock-out  pattern  of  the  TIS. 

Of  course,  this  simple  analysis  is  only  applicable  to  systems  that  have  a  clock-out 
pattern  similar  to  the  one  shown  in  Fig.  3.1 1.  The  concept,  however,  applies  to  all  FPA 
systems  that  produce  a  serial  output,  such  as  analog  video.  The  incorporation  of  this  effect 
may  be  critical  in  some  scenarios,  for  example,  an  electrically  bandwidth-limited  ATR 
device. 

F.  OTHER  EFFECTS 

Although  modeling  3-D  directional  noise  and  aliasing  are  the  largest  second 
generation  modeling  concerns,  they  are  not  the  only  important  ones.  The  consideration  of 
sample  scene-phasing  and  clock-out  frequency  conversion  effects  are  also  important. 
Some  other  effects  that  could  be  critical  to  some  ^plications  include  detector  signal 
processing,  display  enhancements,  non-linear  electronic  signal  processing,  and  display/ 
observer  interaction  effects  [Ref.  23].  These  second  generation  concerns  may  or  may  not 
be  included  in  a  given  second  generation  model,  but  should  be  kept  in  mind  by  system 
modelers  and  users.  Each  is  briefly  discussed  in  the  following  paragraphs. 

Second  generation  detector  arrays,  unlike  their  predecessors,  make  use  of  some 
degree  of  signal  processing  in  the  detector  array  itself.  This  changes  the  nature  of  the 
ouq?ut  signal  from  the  detector  array.  In  first  generation  systems,  the  ou^ut  signal  was  a 
continuous  analog  signal  representing  a  spatial  averaging  across  the  detector’s  active 
dimensions.  With  second  generation  systems,  the  nature  of  this  output  may  be  such  that  it 
is  a  series  of  multiplexed  digital  ouqjuts  representing  a  serial  combination  of  samples  from 
several  detector  elements.  Because  of  this  multiplexing,  it  may  not  be  possible  to  isolate 
noise  and  desired  signals  m  some  systems  to  be  able  to  predict  signal  to  noise  performance. 
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Display  enhancements  have  also  changed  the  way  images  are  presented  to  the  user. 
These  effects  are  not  covered  by  standard  linear  systems  theory.  The  display  enhancements 
utilized  in  second  generation  systems  include  pseudo-color  enhancement,  diso'ete  element 
LED  or  LCD  displays,  and  the  like.  These  display  enhancements  are  not  amenable  to 
simple  MTF  analysis  as  is  the  standard  CRT  of  first  generation  systems.  Modeling  research 
must  be  conducted  to  ensure  proper  inteipretation  of  display  enhancements  on  MRTD 
measurements. 

Electronic  signal  processing  of  system  ou^uts  is  a  natural  consequence  of  the 
growing  sophistication  of  imaging  systems.  Eectronic  signal  processing  in  first  generation 
systems  usually  consisted  of  linear  amplification,  offsetting,  and  filtering.  In  second 
generation  systems,  signal  processing  takes  the  form  of  digitization,  image  enhancement, 
and  image  interpolation  in  addition  to  the  basic  processes.  These  developments  can 
dramatically  change  the  resolvabihty  of  a  target,  and  so  may  change  the  MRTD 
perframance  of  an  imaging  system.  This  type  of  electronic  processing  has  accompanied 
the  increased  use  of  automatic  target  recognition  (ATR)  devices,  and  may  eventually 
require  a  different  and  more  objective  figure  of  merit  than  MRTD  to  evaluate  the 
perframance  of  imaging  systems.  However,  imtil  MRTD  is  superseded,  the  modeling  of 
electronically  processed  data  remains  a  difficult  pr(q>osition. 

A  final  and  continuing  concern  for  second  generation  MRTD  modelers  is  the 
performance  of  the  eye/brain  system.  The  various  methods  used  to  date,  i.e.  the  matched 
filter  response,  or  the  synchronous  integrator  model,  should  be  brought  into  question.  This 
aspect  of  the  entire  image  resolution  process  seems  to  be  the  most  important,  yet  the  least 
understood.  Without  an  accurate  and  precise  model  of  the  display/observer  int^action,  the 
accuracy  of  the  entire  system  model  is  compromised. 
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IV.  EXPERIMENTAL  DESIGN  AND  MEASUREMENTS 

The  literature  contains  several  experimentally  measured  MRTD  curves  [Refs. 
1,15,16,  and  28].  Additionally,  many  p^rs  presenting  models  give  an  MRTD  ‘trend’ 
curve,  used  to  predict  MRTD  trend  performance  as  a  fimction  of  spatial  frequency  [Refs. 
3,9, 10, 14,  and  28] .  Unfortunately,  many  of  the  MRTD  measurement  curves  differ  by  as 
much  as  an  order  of  magnitude  [Refs.  3,15,  and  28];  and  many  of  the  trend  curves  do  not 
include  scaled  axes  [Refs.  14,15,  and  16].  To  measxire  the  success  of  the  VISMODII  model 
developed  in  Cluster  V,  and  compare  its  results  to  the  other  MRTD  prediction  models 
available,  it  was  desirable  that  a  set  of  measurements  be  taken  in  our  own  laborattxy. 
These  measurements  would  not  only  give  a  set  of  data  to  compare  to  the  predictive  results 
of  the  various  models,  but  also  would  give  a  better  ‘feel’  for  the  accuracy  and  reliability  of 
MRTD  measurement  data  reported  in  the  literature.  A  second  purpose  fw  the  laboratory 
measurements  was  to  perform  a  set  of  objective  signal  to  noise  ratio  measurements  that 
could  be  used  in  the  develt^ment  of  an  objective  MRTD.  These  ‘objective’  measurements 
would  simulate  a  simple  ATR  system.  This  data  is  incorporated  in  the  VISMODII  model 
in  the  next  chapter. 

Although  conducted  in  a  laboratory  environment,  these  tests  may  be  more 
apprc^iiately  termed  ‘field  tests’  because  of  the  limited  precision  of  measurement 
equipment  available  and  the  lack  of  positive  control  over  the  laboratory  environment.  Two 
staring  focal  plane  array  imaging  systems  were  utilized.  The  first,  an  Amber  Engineering 
AE4128,  was  a  128x128  staring  focal  plane  array  of  InSb  detectors.  The  second  imaging 
system  used  was  a  Mitsubishi  Electronics  IR-M500  model,  incorporating  a  5 12x5 12  staring 
PtSi  array.  The  first  objective  of  these  laboratory  measurements  was  to  measure  the 
MRTD  for  the  two  systems,  and  compare  the  results  to  those  predicted  by  the  FLIR92  and 
VISMODII  models.  This  cluster  desoibes  the  e^q^erimental  setup  and  methodologies, 
desoibes  the  imaging  systems  used,  and  gives  the  measured  MRTD  data.  The  MRTD 
results  are  compared  to  predictions  obtained  from  the  FLIR92  and  VISMODII  models  in 
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Chapter  VI.  The  second  objective  was  to  conduct  the  objective  signal  to  noise  dafji  The 
data  measured  is  presented  in  this  chapter,  and  discussed  at  greater  length  in  Chapto*  V. 

A.  EXPERIMENTAL  SETUP 

The  e:q>erimental  setup  is  shown  in  Fig.  4.1.  The  target  scene  consisted  of  a 
correctly  scaled  standard  four  bar  test  pattern  against  a  uniform  background.  The  target 
apparatus  is  shown  in  more  detail  in  Fig.  4.2.  The  target  apparatus  consisted  of  a  heated 
back  plate  and  a  cooled  front  plate.  The  four  bar  pattern  was  cut  through  the  front  plate, 
allowing  the  imager  to  view  the  heated  back  plate  through  the  four  bar  pattern.  To  the 
imager,  the  front  plate  provided  the  uniform  (cool)  background,  while  the  back  plate, 
viewed  through  the  pattern  represented  the  (hot)  target.  Thermocouples  mounted  on  the 
front  surface  of  both  allowed  the  temperature  difference  to  be  read  directly.  Both  plates 
were  made  of  shot-blasted  aluminum,  painted  in  a  non-reflective  flat  black  to  ensure 
uniform  emissivity.  The  back  plate  was  heated  by  means  of  an  electrical  current  passing 
through  resistive  heating  elements  mounted  on  its  back  surface. 


Figure  4.1.  Laboratory  setup  for  MRTD  measurements 
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Back  plate  temperature  was  controlled  by  adjusting  the  amount  of  current  provided 
to  the  resistive  heating  elements.  Front  and  back  plates  were  separated  by  10  cm  so  that  the 
front  plate  temperature  remained  near  the  ambient  temperature.  Both  front  and  back  plates 
were  made  of  aluminum  to  provide  high  thermal  conductivity  and  temperature  uniformity 
on  the  surface  visible  to  the  imager.  The  target  platform  was  placed  at  the  prescribed 
distance  from  the  imager  in  a  non-reflective  environment  in  order  to  minimize  reflected 
radiation  from  other  emitting  objects  in  the  room.  All  measurements  were  made  at  an 
ambient  room  temperature  of  ^proximately  295K. 


Figure  4.2.  Target  ty^paratus 
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Nominal  spatial  frequencies  were  determined  by  the  size  of  the  four-bar  pattern,  and 
the  distance  from  the  imager  to  the  target.  As  shown  in  Fig.  4.2,  the  front  plate  set 
consisted  of  a  fixed  template,  over  which  a  second  plate  with  several  different  size  patterns 
was  slid.  In  each  case,  the  bar  height  was  seven  times  the  width  of  one  bar  (i.e.,  7W), 
corresponding  to  the  accepted  standard.  Referring  to  the  dimensions  illustrated  in  Fig.  4. 1 , 
nominal  spatial  frequency  is  given  by: 


where  W  is  the  measured  width  of  one  bar  and  R  is  the  distance  from  tiie  target  to  the 
imager.  The  imager  input  aperture  lens  was  placed  at  target  height,  h,  and  the  target  plate 
fronts  were  aligned  perpendicular  to  the  front  plane  of  the  imager.  Proper  alignment 
eliminated  off-axis  effects,  and  ensured  a  ‘clean’  image  was  viewable  by  the  imager.  Since 
the  measurement  apparatus  and  the  imager  were  necessarily  static,  camera  and  target 
motion  effects  could  not  be  included  in  this  set  of  data.  The  MRTD  measurements  thus 
obtained  are  static  performance  measurements,  implying  that  the  observer  knows  where 
and  when  to  look  for  the  pattern.  This  is  consistent  with  the  static  nature  of  most  laboratory 
models  presented  in  the  literature. 

B.  EXPERIMENTAL  METHOD 

The  actual  measurement  process  was  conducted  as  follows.  Prior  to  data 
measurement,  the  observers  were  trained  in  the  recognition  criteria.  For  these 
measurements,  the  target  was  called  ‘resolved’  when  it  could  be  discerned  that  it  consisted 
of  four  bars.  This  requirement  that  all  four  bars  could  be  fully  discerned  corresponds  to  a 
probability  of  correct  identification  of  100%.  This  differs  slightly  from  some  other  test 
methodologies  in  which  a  50%  detection  probability  is  used  in  measuring  the  MRTD 
[Refs.  1,16].  In  the  50%  methodology  tests,  the  MRTD  is  taken  to  be  the  temperature  at 
which  half  of  the  observers  .could  resolve  the  pattern  and  half  could  not.  The  100% 
detection  methodology  has  intuitive  appeal  because  it  reduces  the  great  variance  in 
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measurements  obtained  from  several  observers  when  the  50%  methodology  is  used  in  the 
presence  of  noise  [Ref.  28].  Standard  measurements  indicate  that  a  50%  probability  of 
detection  corresponds  to  an  SNR  threshold  of  about  3.0;  while  a  100%  detection  probability 
corresponds  to  an  SNR  of  about  6.0  [Ref.  28].  The  validity  of  these  values  is  confirmed  by 
Lloyd,  who  places  a  90%  detection  SNR  threshold  at  4.5  [Ref.  3].  These  differences  in 
detection  methodologies,  then,  can  be  easily  incorporated  in  predictive  models  by  adjusting 
the  threshold  SNR  used  in  the  MRTD  calculations. 

Preparations  for  measurements  included  optimizing  the  imager’s  f-stop,  focus,  and 
alignment  to  ensure  optimal  response.  The  pixel  non-uniformity  correction  process  for  the 
imager  was  then  run,  followed  by  a  calibration.  The  room  was  darkened,  and  the  monitor 
adjusted  by  the  observer  to  optimize  viewing  conditions. 

Measurements  were  conducted  in  both  directions  of  the  heating/cooling  cycle.  One 
set  of  data  was  taken  as  the  back  plate  was  heated  up  from  below  to  above  the  resolvable 
threshold.  The  second  set  was  taken  as  the  back  plate  was  cooled  from  above  to  below  the 
resolution  threshold.  In  each  case,  the  observer  watched  the  display  until  he  could  resolve 
the  four  bar  pattern  (in  the  first  set)  or  could  no  longer  resolve  the  pattern  (in  the  second 
set).  At  the  minimum  resolution  point,  tiie  surface  temperatures  of  the  back  and  front  plate 
were  recorded.  The  difference  between  the  temperatures  is  the  MRTD.  The  spatial 
frequency  of  the  test  pattern  was  then  changed,  and  tiie  process  repeated.  The 
measurements  were  thra  averaged  between  observers,  trials,  and  heating/cooling  cycles  to 
give  one  set  of  data  points  of  MRTD  as  a  function  of  spatial  frequency. 

In  order  to  obtain  a  complete  evaluation  of  available  models,  the  process  was 
repeated  in  both  the  horizontal  (bars  oriented  votically  and  spaced  horizontally)  and 
vertical  (bars  oriented  horizontally  and  spaced  vertically)  directions.  The  results  were 
analyzed  separately  and  also  added  in  quadrature  to  give  a  ccnnposite  two  dimensional 
MRTD  figure  in  the  same  manner  that  is  accomplished  in  the  FLIR92  model  given  in 
Appendix  C. 
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C.  SYSTEM  PARAMETERS 

The  two  different  imaging  systems  used  had  xmique  properties  that  changed  the 
nature  of  the  measurement  data  sets.  In  both  cases,  the  goal  was  to  optimize  the  MRTD 
performance  of  the  imager/observer  system  without  introducing  processing  artifacts  that 
could  not  be  included  in  the  predictive  models.  Complete  system  parameters  are  contained 
in  Appendix  A,  and  a  brief  description  of  each  system  is  provided  in  this  section. 

1.  AMBER  System 

The  AE4128  consists  of  a  camera  assembly  and  a  supporting  electronics  assembly. 
It  operates  in  the  3-5  pm  wavelength  band,  with  a  128x128  InSb  staring  array.  Display  is 
made  on  a  standard  computer  monitor,  which  can  provide  gray-scale  shading  or  pseudo¬ 
color.  The  system  is  shown  in  Fig.  4.3. 


Figure  4.3.  The  AMBER  Engineering  AE4128  system 
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The  camera  assembly  contains  the  imaging  optics,  the  detector  array,  and  a 
cryogenic  dewer  which  must  be  filled  with  liquid  nitrogen  to  maintain  a  detector 

temperature  of  around  77  K.  The  dewer  must  be  evacuated  to  less  than  lO"^  twr  in  order 
to  prevent  condensation  on  the  detector  and  to  prevent  rqjid  loss  of  liquid  nitrogen.  The 
imaging  optics  include  a  2  inch  CaF2  optical  window  that  provides  95%  transmittance  in 
the  3-5  pm  band.  Although  the  requirement  to  provide  a  vacuum  enclosure  and  cryogenic 
cooling  of  the  camera  assembly  is  somewhat  cumbersome,  the  electronic  processing  unit 
gives  the  system  a  great  deal  of  flexibility.  The  electronics  assembly  includes  the  necessary 
drive  electronics,  as  weU  as  a  pixel  non-uniformity  correction  circuit,  scalable  amplifiers, 
and  a  micro-controller.  The  device  has  the  c^ability  to  provide  RS-170  analog  video 
output,  perform  two-point  nonuniformity  correction  on  the  individual  detectors  that  make 
up  the  array,  and  (optionally)  auto-calibrate  global  gain  and  offset.  Additionally,  it  gives 
the  operator  the  ability  to  control  all  clocks,  frame  rates,  and  integration  times.  A  parallel 
digital  interface  for  real  time  ext»nal  processing  of  the  FPA  ouq)uts  is  also  available  [Ref. 
38].  In  addition,  the  monitor  itself  has  the  standard  brighmess  and  contrast  controls.  To 
eliminate  as  many  artifidal  processing  artifacts  as  possible,  these  capabilities  were 
manually  controlled  when  possible.  Global  gain  was  set  to  one.  Global  offset,  which  is 
analogous  to  AC  coupling  of  a  scanning  system,  was  adjusted  to  give  optimal  contrast 
between  target  and  backgroimd.  Frame  rate  and  integration  time  are  expressly  accounted 
for  in  the  predictive  MRTD  models.  The  two  point  calibration  capability  was  utilized  in 
order  to  automatically  minimize  pixel  non-uniformities.  This  routine  takes  measurements 
at  two  uniform  temperatures  (a  hot  lens  cap  and  a  cold  lens  cap)  and  adjusts  pixel 
nonunifcxmities  by  gain  compensating  the  output  of  individual  detectors.  The  observer 
was  allowed  to  adjust  display  brightness  controls  to  optimize  viewing.  The  obsower  was 
also  allowed  to  adjust  his  position  in  order  to  (ptimize  viewing  angle,  and  p-liminatfi  any 
sample  scene  phasing  due  to  eye  position. 


73 


2.  Mitsubishi  Electronics  System 

This  system  is  a  conveniently  packaged  unit  that  does  not  require  an  evacuated 
chamber  or  external  cryogenic  cooling.  The  Mitsubishi  camera  contains  a  cryogenic 
Stirling  cycle  cooler  to  provide  detector  temperature  control,  operating  at  around  80  K.  It 
also  operates  in  the  3-5  |Jm  band,  with  a  5 12x512  PtSi  array.  This  unit  contains  many  of 
the  automatic  features  of  the  AMBER  system,  but  does  not  allow  for  operator  manual 
control.  Instead,  the  unit  is  almost  completely  automatic  and  self-contained,  with  only  a 
pal-  sized  wired  remote  controller.  The  system  is  pictured  in  Fig.  4.4.  Although  some 
information  is  provided  in  the  user’s  manual  [Ref.  40],  most  of  the  technical  specifications 
listed  in  Appendix  A  were  obtained  firom  Mitsubishi  America  in  Cypress,  CA  [Ref.  41]. 


Figure  4.4.  The  Mitsubishi  IR-M500  system 
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D.  MRTD  MEASUREMENT  RESULTS 


The  average  MRTD  measurement  data  is  provided  here  in  graphical  form  for  both 
horizontal  and  vertical  MRTD’s  for  both  the  Amber  and  Mitsubishi  systems.  Complete 
measurement  results  are  provided  in  Appendix  D  in  tabular  and  graphical  form.  Figure 
4.5  portrays  the  average  measured  MRTD’s  for  the  Amber  system.  Figure  4.6  shows  the 
average  measured  MRTD’s  for  the  Mitsubishi  system.  Figures  4.7  and  4.8  present  the  same 
data  on  a  logarithmic  scale.  This  data  is  compared  to  predictions  from  FLIR92  and 
VISMODn  in  Chapter  VI.  There  are  several  trends  notable  from  these  results,  and  each  is 
discussed  in  the  paragraphs  that  follow. 

First,  each  system  MRTD  seems  to  approach  the  low  frequency  limit  at  an 
asymptotic  value  that  is  greato-  than  zero.  This  trend  serves  as  the  motivation  for  the 
visibility  method  used  in  VISMODE,  described  in  the  next  chiq>ter. 

Second,  there  is  a  measurable  difference  in  recorded  values  for  the  horizontal  and 
vertical  MRTD  values.  This  is  attributable  to  the  different  values  of  system  MTF  in  ihe  two 
directions,  and  possibly  to  tlie  difference  in  converted  temporal  frequency  between  vertical 
and  horizontal  cells  caused  by  the  clock-out  process,  as  described  in  Ch^ter  I. 

Third,  there  is  a  marked  difference  between  measurements  taken  as  the  back  plate 
is  heated  up  past  the  MRTD  and  measmements  taken  when  the  back  plate  is  cooled  down 
below  the  MRTD.  This  trend  is  noticeable  in  both  the  Amber  and  Mitsubishi  tests 
conducted,  and  may  indicate  a  perception  factor  or  eye/brain  process  whereby  an  image  is 
easier  to  track  as  it  fades  after  it  has  already  been  resolved  by  the  observw  than  it  is  to 
recognize  a  new  image  appearing  out  of  noise. 

Fourth,  there  is  the  obvious  trend  that  the  MRTD  r^idly  ino-eases  above  a 
particular  value  of  spatial  frequency.  This  matches  the  trend  present  in  most  measured  and 
predicted  data  [Refs.  1,3,15,  and  28]. 

Fifth,  the  Mitsubishi  system  performance  was  approximately  twice  as  good  as  the 
Amber,  even  more  so  at  low  spatial  frequencies.  This  is  probably  because  of  the  larger 
array  size  and  greater  resolution  of  the  Mitsubishi  system. 
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Sixth,  for  the  Mitsubishi  imager,  the  vertical  MRTD  is  higher  than  the  horizontal 
MRTD.  This  is  noticeable  in  the  Amber  system  as  well,  to  a  lesser  extent.  This  suggests 
a  difference  in  the  array  clock  out  process  which  manifests  itself  as  a  contrast  degradation 
in  one  direction  more  than  the  other. 

Finally,  the  low  frequency  asymptotic  value  is  different  for  the  two  systems, 
suggesting  a  system  dependent  threshold  temperature  difference  that  can  be  resolved  in  the 
low  frequency  limit.  This  threshold  could  conceivably  be  predicted  from  device 
parameters. 

Measurement  precision  for  these  tests  was  unavoidably  poor,  and  is  valid  to  within 
0.0556  Celsius  (0.1  degrees  F).  This  was  the  tolerance  of  the  thermocouples  used  to 
measure  the  plate  temperatures  and  the  thermocouple  read  out  displays. 
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Figure  4.5.  Average  MRTD  measurements  for  the  AMBER  system 


Figure  4.6.  Average  MRTD  measurements  fm*  the  Mitsubishi  system 
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Figure  4.7.  Average  MRTD  results  for  the  AMBHl  system,  logarithmic  scale 

— 


Figure  4.8.  Average  MRTD  results  for  the  Mitsubishi  system,  logarithmic  scale 
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E.  OBJECTIVE  MRTD  MEASUREMENTS 

As  discussed  in  Chqjters  I  and  HI,  thoe  are  several  concerns  regarding  the 
nrtrytinupA  use  of  the  MRTD  as  a  figure  of  merit  for  second  generation  systems.  Hie 
fundamental  drawback  of  the  MRTD  is  its  dependence  on  a  human  observer  to  subjectively 
interpret  the  ‘resolvability’  of  a  given  scene.  The  lack  of  objectivity  and  repeatability  of 
this  type  of  measurement  was  clearly  demonstrated  in  our  own  MRTD  measuremoits  as 
well.  In  order  to  explore  the  feasibility  of  an  objective  measurement  of  resolvability,  some 
pHHirinnfli  measurements  were  made.  It  is  hoped  that  this  data,  although  very  simple  in 
nature,  can  motivate  the  development  of  an  objective  MRTD  standard. 

The  use  of  an  electronic  ATR  device  implies  that  the  resolvability  of  the  targetmust 
be  objectively  discwnible  from  the  electronic  signal  and  noise  of  the  target  scene.  To 
CTmniatp.  a  simple  ATR  system,  an  oscilloscqie  (Tektronix  model  number  468)  was 

into  the  measurement  process  as  shown  in  Fig.  4.9.  The  osdlloscope  serves  as  the 
simplest  of  ATR  devices,  measuring  only  the  SNR  of  the  imager’s  output  signal.  The 
Mitsubishi  system  was  used  for  these  measurements. 


Figure  4.9.  Automatic  target  recognition  simulation  setup 
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Three  simple  measurement  tasks  were  accomplished  with  this  setup.  First,  the  SNR 
measured  by  the  oscUloscoiJe  was  held  constant  as  the  spatial  frequency  of  the  target  was 
varied  and  the  temperature  difference  between  target  and  background  was  measured.  An 
SNR  of  6.0  was  chosen,  corresponding  to  a  100%  probability  of  detection,  and  matching 
that  of  the  previous  MRTD  measurement  tests.  The  SNR  measurement  is  demonstrated  in 
Fig.  4.10.  In  the  figure,  the  signal  corresponding  to  the  four  bars  of  the  target  pattern  is 
clearly  visible.  The  oscilloscope  display  was  synchronized  to  one  line  of  video  that  passed 
through  the  bar  pattern.  Figure  4. 10  shows  one  tenth  of  the  length  of  a  single  scan  line,  the 
portion  that  contained  the  bar  pattern.  The  variance  of  the  noise  present  in  the  system 
output  is  apparent  as  well. 


Figure  4. 10.  Measurement  of  SNR  from  oscilloscope  data 


Second,  the  temperature  difference  between  target  and  backgroimd  was  held 
constant  as  the  spatial  frequency  was  varied  and  the  SNR  was  measured.  The  temperature 
difference  used  was  3.5  Celsius,  to  ensure  adequate  signal  levels  for  the  full  range  of  spatial 


frequencies  used.  Third,  the  spatial  frequency  of  the  target  pattern  was  held  constant,  as 
the  SNR  was  varied  and  the  temperature  difference  was  measured.  A  mid-range  spatial 
frequency  of  0.5  cy/mrad  was  used. 

The  three  sets  of  measurement  data  are  plotted  as  Figs.  4.1 1, 4.12,  and  4.13.  The 
data  is  presented  in  tabular  form  in  Appendix  D.  It  was  clear  from  these  measurements  diat 
the  human  eye  is  a  fantastic  device  for  picking  a  signal  out  of  noise.  To  achieve  an 
objectively  measured  SNR  of  6.0,  which  corresponded  to  MRTD  in  the  subjective 
measurement  case,  it  was  necessary  to  increase  the  temperature  difference  a  great  deal 
beyond  that  required  to  resolve  the  four  bars  on  the  monitor.  In  this  case,  the  signal  was 
not  discernible  in  the  oscilloscope  display  until  it  was  well  past  minimum  resolvability  on 
the  monitor  display.  This  perhaps  explains  the  reluctance  to  let  go  of  the  human  percq>ti<Mi 
element  in  a  resolvability  standard,  as  an  ATR  that  can  match  human  performance  would 
be  difficult  to  build.  The  use  of  this  data  in  the  development  of  an  objective  MRTD  is 
discussed  in  the  next  chq>ter. 
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V.  SECOND  GENERATION  VISIBILITY  MODEL 


The  proper  modeling  of  second  generation  staring  arrays  is  an  elusive  task. 
Although  second  generation  models  exist,  they  are  mainly  direct  descendants  of  first 
generation  linear  models  with  the  addition  of  a  correction  factm*  to  accoimt  for  directional 
noise  effects.  Staring  array  imagers  are  so  different  in  their  operation  that  it  is  q>timistic 
to  expect  these  first  generation  models  to  produce  accurate  MRTD  predictions  [Ref.  39]. 
One  of  the  disadvantages  of  a  second  generation  model  derived  from  the  first  generation  is 
its  dependence  on  a  subjective  MRTD.  As  discussed  in  the  literature  [Refs.  8,2539]  and 
measured  in  the  laborahuy  (^pendix  D),  the  subjective  MRTD  has  disadvantages  as  a 
figure  of  merit.  In  particular,  the  unrepeatability  and  wide  variance  in  measurement  results 
of  the  MRTD,  and  the  widespread  development  of  automatic  target  recognition  (ATR) 
devices  make  it  desirable  that  a  model  could  incorporate  an  objective  measure  of 
resolvability  [Ref.  9] .  However,  because  current  state  of  the  art  ATR  devices  cannot  match 
the  performance  of  the  human  eye  in  resolution  tasks,  the  new  model  should  also  be  able 
to  make  subjective  MRTD  predictions  for  human  observer  systems. 

The  concepts  that  serve  as  the  foundation  for  the  first  generation  visibility  model, 
presented  in  Chapter  n,  are  compatible  with  the  goal  of  supporting  both  an  objective  and 
subjective  MRTD.  Since  the  visibility  model  makes  no  assumptions  about  the  observation 
process,  it  is  applicable  to  the  case  where  the  observer  is  not  a  human  being  at  all.  A4>plying 
the  visibility  concepts  to  the  unique  problem  posed  by  staring  array  inugers  is  the  basis  for 
the  second  generation  visibility  model,  VISMODII.  The  VISMODII  has  been  developed 
to  allow  the  incorporation  of  directional  noise  effects,  sampling/aliasing  effects,  scene 
phasing  effects,  and  non-zo'o  FTP’s,  within  the  framework  the  visibility  model  provides. 
The  model  developed  extends  the  ^plicability  of  an  MRTD  predictive  model  into  the 
region  beyond  the  nominal  system  Nyquist  frequency,  includes  fixed  pattern  noise  effects 
mherent  in  staring  array  systems,  and  supports  both  subjective  and  objective  resolvability 
CTiteria.  Because  of  the  simplicity  of  concept  but  completeness  of  the  model,  it  could  serve 
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as  a  valuable  predictive  model  for  a  wide  range  of  thermal  imaging  systems,  and  as  a 
platform  for  the  further  development  of  an  objective  resolvability  standard. 

A.  VISMODD  OVERVIEW 

The  first  generation  visibility  model  presented  a  new  method  for  prediction  of 
MRTD  performance  based  on  a  threshold  resolvable  contrast,  and  a  one-dimensional 
contrast  reduction  parameter  derived  from  the  spatial  frequency  limited  performance  of  TIS 
sub-systems.  The  motivation  for  this  concept  was  provided  by  both  measured  MRTD 
results,  and  by  the  standard  mathematical  formulation  of  MRTD  as  given  by  Eq.  3.5.  These 
two  items  suggest  the  formulation  of  MRTD  as  the  product  of  two  factors;  one  frequency 
dependent,  the  other  not;  as  in  Eq.  2. 18.  The  visibility  model  had  three  distinct  advantages 
over  other  first  generation  predictive  models.  First,  it  was  much  simpler  and  had  intuitive 
^peal  because  it  did  not  rely  on  a  precise  modeling  of  the  eye/brain  resolution  process. 
The  conflict  of  matched  filter  response  versus  synchronous  integrator  response  for  the  eye/ 
brain  system  was  avoided.  Second,  it  could  readily  incorporate  non-zero  phase  transfer 
functions  (PTF’s)  in  the  MRTD  prediction.  Finally,  it  had  better  correlation  with  measured 
results  than  other  first  generation  models. 

The  problems  of  fixed  pattern  directional  noise,  aliasing,  and  scene  phasing,  as 
presented  in  Chtqiter  HI,  must  also  be  addressed  in  predictive  models  for  staring  arrays. 
Other  second  generation  models  have  addressed  these  problems  by  ‘patching  up’  first 
generation  models  with  one  or  more  directional  correction  factors.  These  attempts  appear 
to  be  inadequate  for  accurate  prediction  of  performance  for  staring  FPA’s,  because  they 
discount  the  unique  aspects  of  second  generation  imaging  systems  [Refs.  4,23,39].  These 
unique  aspects  include  sampling  efrects  in  two  dimensions,  useful  resolution  information 
provided  beyond  the  nominal  system  Nyquist  frequency,  and  scene  phasing  effects.  In 
addition  to  not  including  the  above  effects,  the  accuracy  of  the  various  ad-hoc  perception 
factors,  eye/brain  models,  and  spatial/temporal  integration  factors  has  been  called  into 
question  [Refs.  9,16,39].  The  very  simplicity  of  the  visibility  model  concept  serves  weU 
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in  this  regard.  The  second  generation  modeling  considerations  of  Chapter  in  can  easily  be 
incorporated  into  the  concepts  of  the  visibility  model  without  including  elabOTate 
imderlying  assumptions. 

1.  yiSMODn  Modeling  Concepts 

This  sub-section  provides  a  brief  overview  of  the  VISMODH.  The  derivations  of 
die  quantities  tiiat  appear  here  are  found  in  later  sections  of  tiiis  chapter.  As  in  the  first 
generation  visibility  model,  VISMODH  suggests  a  form  for  MRTD  such  as: 

MRTD(f  J  =  MRTD(f,  0)  x  ^ ,  (5.1) 

which  includes  a  low  frequency  hmit  term  for  MRTD,  modified  by  ±e  aff^)  tem  which  is 
defined  as  the  contrast  transference  parameter.  As  indicated  by  the  subscript  ‘z’,  this 
representation  can  be  applied  in  either  horizontal  or  vertical  directions.  In  the  low 
frequency  limit,  the  bar  pattern  is  assumed  to  iq>pear  as  a  step  function  within  the  field  of 
view.  Ultimately,  in  the  low  frequency  limit,  the  ^plication  of  resolution  enhanring 
perception  factors  is  inappropriate  as  integration  over  the  entire  bar  pattern  does  not  talre 
place  [Ref.  9].  The  VISMODH,  in  consonance  with  measured  data,  but  unlike  other 
predictive  models,  assumes  that  there  is  a  non-zero  threshold  minimum  input  contrast  that 
can  be  resolved  in  the  low  fi:equency  limit.  This  value,  denoted  as  ATjg,  is  system  and 
observer  dependent.  It  could,  as  t^propriate,  denote  the  minimum  contrast  resolvable  by  a 
human  observer  or,  separately,  the  minimum  contrast  resolvable  by  an  ATR  device.  This 
term  inherently  contains  aU  of  the  observer  and  system  noise  effects  without  m  wiring 
assumptions  about  their  nature.  So,  one  imaging  system  could  have  multiple  thresholds  for 
different  types  of  observers. 

The  contrast  transference  parameter,  a(f),  includes  all  frequency  depp-ndent 
contrast  degradation  of  the  system.  VISMODH  includes  two  dimensional  aliasing  and 
scene  phasing  effects  for  sampled  imaging  systems  such  as  FPA’s  in  the  fcnmulation  of  the 
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contrast  transference  parameter.  Thus,  the  two  dimensional  effects  of  aliasing  and  blurring 
are  included  in  this  one  parameter. 

Figure  5.1  shows  the  salient  features  of  VISMODII.  As  shown  in  the  figure,  a  two 
dimensinnfll  four  bar  spatial  image  input  will  experience  a  contrast  degradation  in  both 
dimensions  due  to  the  blurring  effects  of  the  TIS  sub-systems  and  an  aliasing  effect  due  to 
sampling  by  the  detector  array  geometry.  The  net  result  is  that  a  rectangular,  high  contrast 
input  function  appears  at  the  display  point  as  a  ‘smoothed-out’  image  with  degraded 
contrast.  Referring  to  the  quantities  shown  in  Fig.  5.1,  the  contrast  transference  for  a 
particular  target  spatial  frequency  is  defined  as: 


a(f)  = 


AT^Cf) 

AT  ■ 


(5.2) 


It  is  the  proposition  of  VISMODII  that  the  relationship  between  MRTD  and  AT^^ 
for  a  range  of  target  spatial  frequencies  can  be  given  by; 

MRTD(f)  =  (5.3) 

a(f) 

The  particular  formulation  of  both  the  threshold  input  contrast  and  the  contrast  transference 
parameter  are  provided  in  subsequent  sections  of  this  chapter. 
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Figure  5. 1  also  makes  clear  some  of  the  differences  between  the  first  and  second 
generation  visibility  models.  The  most  obvious  difference  is  that  VISMODII  operates  on 
an  exact  two  dimensional  fast  Fourier  transform  (FFT)  of  the  four  bar  target.  The  first 


generation  visibility  model  approximated  the  target  pattern  as  a  one  dimensional  square 
wave,  that  was  further  divided  into  individual  sinusoidal  components.  Since  the  spectrum 
used  in  VISMODII  is  exact,  there  is  no  estimation  error  introduced. 
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Formulation  of  the  various  MTF’s  and  PTF’s  also  differ  between  the  two  models. 
VISMODH  contains  some  more  sophisticated  sub-system  transfer  fimctions.  This  change 
may  enable  more  precise  modeling  of  actual  sub-systems,  but  does  not  change  any  of  the 
salient  features  of  the  model. 

Two  dimensional  sampling  and  aliasing  effects  are  included  in  VESMODII.  In  real 
systems,  significant  resolution  information  is  often  available  even  in  the  presence  of 
aliasing  effects.  YISMODII  uses  system  specific  sampling  information  to  extend  the 
concept  of  resolvable  contrast  beyond  the  Nyquist  limit  of  the  system. 

Sample  scene  phei;.;ing  effects  are  properly  included  in  the  analysis  as  part  of  the 
aliasing  subroutine.  This  is  possible  because  the  complex  values  of  spatial  frequency 
domain  quantities  are  retained  in  the  analysis,  allowing  the  easy  introduction  of  scene 
phasing  effects. 

The  heuristic  prediction  for  a  subjective  AT^^.  incorporates  directional  noise  effects, 
modifying  the  simple  NETD  used  in  the  first  generation  model.  Also,  an  objective  AT^^.  is 
provided  based  on  an  ATR  simulation  as  described  in  Chapter  IV.  Threshold  input  contrast 
can  be  direcdy  input  into  the  model  if  it  is  available  by  measurement  or  other  means. 

Since  VISMODII  operates  in  the  two  dimensional  spatial  frequency  domain,  it  can 
include  contrast  degradation  effects  in  both  dimensions  of  the  four  bar  pattern.  It  easily 
calculates  both  vertical  and  horizontal  MRTD’s  by  rotating  the  four  bar  pattern  90  degrees 
in  the  analysis.  The  model  could  also  be  upgraded  to  predict  performance  at  any  target 
angle. 

3.  VISMODn  Programming  and  Logical  Flow 

VISMODII  is  written  using  the  MATLAB  high-performance  computational 
software.  US  input  parameters  for  a  particular  device  are  loaded  at  the  front  end. 
VISMODH  operates  primarily  in  the  two  dimensional  spatial  frequency  domain  where 
most  relevant  effects  are  most  easily  implemented.  The  logical  flow  of  the  program,  and 
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the  domain  in  which  particular  calculations  take  place  are  shown  in  Fig.  5.2.  The  ar.fiigl 
MATLAB  code  used  is  included  in  Appendix  E. 

As  previously  stated,  VISMODH  incorporates  all  frequency  dqjendent  effects 
including  aliasing  and  scene  phasing  into  the  contrast  transference  parameter.  The 
program  works  on  one  spatial  frequency  at  a  time,  and  loops  through  all  spatial  frequencies 
of  interest  to  obtain  the  contrast  transference  parameter  as  a  function  of  spatial  frequency. 
Calculating  a(f)  involves  both  a  linear  MTF/PTF  analysis  and  a  simulated  sampling 
process,  both  of  which  are  accomplished  in  the  spatial  frequency  domain.  VISMODII 
works  by  creating  a  four  bar  target  pattern  in  the  spatial  domain,  and  taking  its  exact  two 
dimensional  FFT.  As  the  various  spatial  frequencies  are  analyzed,  the  four  bar  pattern 
remains  the  same,  but  the  axes,  MTF/PTF’s,  and  the  sampling  process  are  scaled 
^propiiately.  VISMODII  calculates  an  image  formation  MTF  which  is  applied  to  the  FFT 
of  the  bar  target  by  multiplication  in  the  frequency  domain.  Sampling,  a  two  dimpnairtnai 
multiplication  process  in  the  spatial  domain,  is  simnlatipd  by  the  convolution  of  the  filtered 
target  spectrum  with  the  FFT  of  the  sampling  array.  The  net  result  of  this  process  is  that 
the  resulting  spectrum  is  repeated  at  multiples  of  the  sampling  frequency  in  both  the 
horizontal  and  vertical  directions.  A  second  result  is  the  inclusion  of  an  apprr^riate  scene 
phasing  cmnplex  exponential  which  models  any  misalignment  of  the  target  image  on  the 
FPA.  This  aliasing/scene  phasing  term,  and  the  original  spectrum,  are  multiplied  by  the 
image  reconstruction  filter.  The  resulting  filtered  spectrum  is  then  inverse  transformed  into 
the  spatial  domain  by  the  inverse  two  dimensional  FFT.  A  contrast  value  is  found  by  a 
directional  averaging  process  across  the  bars  and  troughs  of  the  reconstructed  image.  This 
contrast  value  is  modified  by  an  aliasing  term  calculated  by  comparing  aliasivl  anH  non- 
aliased  reconstructed  images.  The  contrast  value  is  then  combined  with  the  AT«.  term  to 
give  a  predicted  MRTD  curve  for  the  device. 
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Figure  5.2.  VISMODII  logical  diagram 


B.  CONTRAST  TRANSFERANCE  PARAMETER 


The  most  computationally  intensive  portion  of  VISMODII  is  the  calculation  of  the 
contrast  transference  parameter.  The  parameter  given  by  Eq.  5.2  contains  all  of  the 
frequency  dependent  contrast  degradation  effects  of  the  imaging  system.  In  VISMODII  it 
includes  both  blurring  and  aliasing  type  degradations.  The  blurring  effect,  caused  by  the 
spatial  frequency  filtering  effects  of  the  individual  sub-systems,  are  treated  by  a  linear 
analysis  much  like  that  accomplished  in  other  MRTD  models.  The  sampling/aliasing  and 
scene  phasing  effects  are  not  common  to  other  predictive  models,  and  will  be  treated  in 
greater  detail  in  this  section. 

The  determination  of  a  contrast  transference  necessarily  begins  with  a  two 
dimensional  four  bar  target  pattern,  a  reproduction  of  which  is  shown  in  Fig.  5.3  (resolution 
of  figure  reduced  for  display  purposes).  An  exact  two  dimensional  FFT  of  the  pattern  is 
taken  to  allow  the  remaining  MTF  analysis  and  sampling  simulation  to  be  accomplished  in 
the  spatial  frequency  domain. 


Figure  5.3.  Foiu-  bar  target  pattern  (f,  =  0.6  cy/mrad) 
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1.  MTF/PTF  Analysis  in  VISMODII 

The  MTF/PTF  analysis  of  VISMODII  is  accomplished  by  means  of  a  cascade  of 
sub-system  transfer  functions.  It  was  desirable  to  include  s(q)histicated  MTF’s  in  the 
analysis  for  precision,  but  not  clutter  the  analysis  with  multiple  complex  MTF  equations 
that  are  nominally  set  to  one  in  almost  every  case.  Additional  MTF’s  are  easily 
incorporated  into  the  model  without  changing  the  salient  features.  Additional  PTF’s  are 
also  easily  introduced  because  the  real  and  imaginary  parts  of  all  variables  are  retained. 
Additional  MTF’s  simply  accelerate  the  trend  toward  a  Gaussian  system  response  [Refs 
3,6].  No  target/imager  relative  motion  MTF’s  are  included  in  VISMODII,  making  it  a 
static  performance  model.  Following  the  organization  of  MTF/PTF’s  presented  in  the 
aliasing  portion  of  Chapter  DI,  the  sub-systems  are  divided  into  two  groups.  The  image 
formation  MTF  includes  diffraction  limited  optics,  geometric  blurted  optics,  and  the 
detector  spatial  MTF’s.  The  equations  for  the  four  MTF’s  are  given  below.  Note  that 
because  of  assumed  circular  optical  geometry,  both  of  the  optical  MTF’s  are  symmetric  in 
two  dimensions,  while  the  detector  spatial  MTF’s  may  be  asymmetrical  if  the  detector 
geometry  is  not  square. 


(5.4) 

Hogb(^)  =  exp(-2ji^ag^f^) 

(5.5) 

sin(7iAxf„) 

nAxf/ 

(5.6) 

sin(KAyf„) 

(5.7) 

The  and  transfer  functions  are  defined  previously.  Hogj,  is  a  geometric  blur  MTF 

used  to  describe  serious  aberrations  in  the  system  optics.  The  net  image  formation  filter  is 
given  by: 
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Hi  =  H„pi(f)H„gi,(f)H,,i(f,)H,^^(fy)  .  (5.8) 

In  the  frequency  domain,  the  cascaded  MTF’s  of  the  image  formation  filter  take  a 
two  dimensional  shape,  centered  at  spatial  frequency  coordinates  (0,0).  The  image 
formation  filter  for  the  Mitsubishi  system  is  shown  in  Fig.  5.4.  The  familiar  ‘sine’  function 
pattern  arising  from  the  rectangular  detector  geometry  is  clearly  seen  in  the  figure. 


Figure  5.4.  Image  formation  frlter  for  Mitsubishi  system 


The  image  reconstruction  frlter  contains  all  post-sampling  processing  of  the  image. 
The  image  signal  has  now  been  converted  to  a  one-dimensional  electrical  signal  by  the 
detectms.  Phase  transfer  functions  may  now  be  introduced  by  the  electronic  processing  of 
the  post-detector  sub-systems.  For  simplicity,  VISMODII  includes  only  the  three  most 
significant  effects  in  the  reconstruction  frlter.  An  electronics  MTF,  electronics  PTF,  and 
display  MTF  are  included.  These  sub-system  filtering  characteristics  are  given  by; 
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(5.9) 


PTFe,„,  =  -atan^  (5.10) 

Hjj(f)  =  exp(-2Tc^aV)  .  (5.11) 

The  net  image  reconstruction  filter  is  given  by; 

Hr(f)  =  H,iect(f)Hd(f)exp(jPTF,„,^(f)) 

The  image  reconstruction  filter  for  the  Mitsubishi  system  is  shown  in  Fig.  5.5. 


Figure  5.5.  Image  reconstruction  filter  for  Mitsubishi  system 
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2.  Aliasing  and  Scene  Phasing  in  VISMODIl 

VISMODn  includes  aliasing  and  scene  phasing  in  the  predictive  model  by 
repeating  the  filtered  target  spectrum  at  intervals  of  the  sampling  frequency  in  both 
horizontal  and  vertical  directions.  Since  these  spectra  retain  their  complex  nature, 
multiplication  by  a  complex  exponential  corresponding  to  scene  phasing  is  easily 
accomplished  if  desired.  The  resulting  frequency  domain  pattern  is  quite  complex.  It 
contains  the  original  filtered  spectrum  plus  copies  of  the  origiaal  repeated  at  horizontal  and 
vertical  spatial  sampling  frequencies.  This  resultant  spectrum  is  then  multiplied  by  the 
image  reconstruction  MTF  and  PTF.  Since  the  image  reconstruction  filter  is  centered  at 
coordinates  (0,0)  and  quickly  drops  to  zero  (see  Fig.  55),  most  of  the  rq>eated  aliasing 
spectra  are  filtered  out  almost  entirely.  The  original  filtered  image  also  has  some  high 
frequency  content  filtered  out.  The  final  spectrum  resulting  has  all  of  the  blurring  and 
aliasing  effects  of  the  device  included.  It  contains  the  reconstruction  filtered  original 
image,  and  a  vestige  of  the  alias  terms.  This  spectrum  is  then  used  to  calculate  the  contrast 
transference  parameter.  As  an  alternative,  VISMODIl  also  implements  an  optional  sample 
scene  phase  M7P,  just  as  implemented  in  FLIR92.  The  feasibility  of  neglecting  both 
aliasing  and  scene  phasing  effects  are  studied  in  the  next  chapter. 

3.  Contrast  Transference  Parameter  Calculation 

In  VISMODn,  the  filtered  and  aliased  target  spectrum,  and  a  cr^y  of  the  filtered 
un-aliased  target  spectrum  are  retained  for  the  output  contrast  determination.  Both  of  these 
spectra  are  inverse  transformed  back  into  the  spatial  domain  by  the  inverse  two  dimensional 
FFT.  The  ouqjut  image  corresponding  to  the  unaliased  voaion,  as  expected,  is  a 
‘smoothed’  out  version  of  the  iiq>ut  four  bar  pattern,  with  a  noticeably  reduced  contrast. 
The  contrast  reduction  is  a  function  of  the  input  spatial  frequency  of  the  bar  pattern,  as 
shown  in  Fig.  5.6  and  Fig.  5.7.  Comparing  the  two  figures  illustrates  the  dramatic 
difference  in  contrast  transference  as  a  function  of  the  target  spatial  frequency.  The  pattern 
at  the  higher  spatial  frequency  has  had  its  contrast  reduced  to  a  mudi  greater  extent. 
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Figure  5.6.  Filtered  output  target  image,  spatial  frequency  =  0.1  cy/mrad 


Figure  5.7.  Filtered  ouqjut  target  image,  spatial  frequency  =  1.1  cy/mrad 
To  determine  the  contrast  present  in  the  final  image,  a  two  dimensional  averaging 
process  is  ^plied  to  the  portions  of  the  output  image  corresponding  to  the  peaks  of  the  bars 
and  the  troughs  in  between  them.  The  average  over  the  peaks  is  denoted  as  Tp,  and  the 
average  over  the  troughs  is  denoted  T^.  The  averaging  process  for  each  occurs  in  two 
dimensions  to  account  for  contrast  degradation  along  the  long  dimension  of  the  bars  as  well 
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as  the  nominal  pattern  direction  described  by  the  bar  width.  The  difference  between  the 
two  averages  represents  the  unaliased  output  contrast.  This  value  is  modified  by  the 
subtraction  of  an  alias  noise  value. 

The  alias  noise  value  is  determined  by  subtracting  the  imaliased  output  image  from 
the  aliased  one.  The  variance  of  this  zero-mean  random  noise  over  the  target  area  is  taken 
to  be  the  ‘alias  noise’,  denoted  value  is  subtracted  from  the  unaliased  output 

contrast  to  give  a  final,  aliased  contrast  transference  parameter.  Fot  a  given  target  spatial 
frequency,  the  output  contrast  value  is  given  by; 

4T,(f)  =  Tp(f)  -  T,(f  )-Oji„(f)  (5.13) 

The  nominal  input  contrast  is  set  to  one  for  all  spatial  frequencies,  so  the  contrast 
transference  parameter  is  effectively  given  by: 

a(f)  =  AT,(f)  (5.14) 

To  obtain  a  contrast  transference  parameter  as  a  function  of  spatial  frequency,  this 
process  is  repeated  over  the  range  of  spatial  frequencies  of  interest.  The  contrast 
transference  parameter  for  the  Mitsubishi  system,  for  horizontal  MRTD,  is  shown  in  Fig. 
5.8. 
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Figure  5.8.  Contrast  Transference  parameter,  Mitsubishi  system 


C.  THRESHOLD  INPUT  CONTRAST 

The  determination  of  a  oitical  input  contrast  threshold  for  a  particular  TIS/observer 
system  is  difficult.  Of  course,  the  best  way  to  determine  this  value  is  to  measure  the  TIS/ 
observer  system’s  response  to  a  step  function.  The  TIS/observer  system  implies  that  there 
may  be  more  than  one  type  of  observer,  and  therefore  more  than  one  ATj^.  for  a  single  TIS. 
The  advantage  of  the  simplified  visibility  concept  is  that  no  a  priori  assumptions  about  the 
observer  are  made.  For  the  two  TIS  used  in  the  laboratory  measurements  of  Chapter  IV, 
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there  is  a  clear  low  frequency  trend  toward  a  non-zero  threshold  input  contrast.  The  values, 
as  measured  in  the  laboratory,  and  taken  from  Fig.  4.5  and  Fig.  4.6,  are  given  in  Table  5.1. 
TABLE  5.1.  Subjective  threshold  input  contrast 


System 

(Celsius) 

Amber 

0.4 

Mitsubishi 

0.07 

If  this  parameter  cannot  be  obtained  by  measurement,  the  threshold  input  contrast 
may  be  predicted  from  device  parameters.  For  a  subjective  human  observer  based  system 
this  requires  the  incorporation  of  directional  noise  effects,  ad  hoc  perception  factors,  and 
eye/brain  process  modeling.  Fot  the  objective  ATR  observed  system  the  value  could, 
presumably,  be  derived  from  objective  data.  Each  type  of  threshold  input  contrast  value 
is  discussed  in  greater  detail  in  the  following  sub-sections. 

1.  Analysis  for  Subjective  Minimum  Hireshold  Contrast 

To  be  of  value  as  a  predictive  model,  it  is  desirable  that  a  human  observer  based, 
subjective  AT^^  be  predictable  from  device  parameters.  A  heuristic  analysis  for  calculation 
of  the  minimum  threshold  contrast  is  presented  here.  Although  this  requires  the  inclusion 
of  perception  factors,  integration  factors,  etc.;  most  of  these  factors  are  postulated  as  having 
no  significant  effect  in  the  low  spatial  frequency  limit.  In  the  low  frequency  limit  the 
treatment  of  the  bar  pattern  as  a  periodic  function  is  questionable.  Instead,  it  can  be  treated 
as  a  stq>  function  [Ref.  9].  In  the  first  generation  visibility  model,  the  formulation  of  AT^ 
was  given  by  Eq.  2.2 1 .  This  formulation  effectively  rq)laces  the  reference  bandwidth  with 
an  actual  noise  bandwidth  for  the  system,  and  incorptn'ates  a  temptn-al  integration  factor  for 
the  eye  [Ref.  9].  For  the  sample  system  of  ^pendix  A  this  yielded  a  value  of 0.208  Celsius 
for  a  system  with  an  NETD  of  0.36  Celsius  [Ref.  9]. 


In  FLIR92,  the  incorporation  of  directional  noise  concepts  resulted  in  the  re¬ 
formulation  of  the  noise  term  in  the  MRTD  analysis.  The  temporal  pixel  noise,  was 
based  on  the  NETD  as  given  by  Eq.  3.7.  In  FLIR92,  the  NETD  was  modified  by  a  system 
noise  bandwidth,  similar  to  the  actual  noise  bandwidth  term  given  in  the  first  generation 
visibility  model.  The  FLIR92  formulation  for  MRTD  also  included  temporal  and  spatial 
eye  integration  effects  and  directional  noise  correction  factors. 

Consistent  with  the  concepts  presented  in  each  of  the  above  models,  the  heuristic 
formulation  for  a  subjective  AT^^  includes  three-dimensional  noise  correction,  temporal 
integration,  and  a  bandwidth  correction  term.  Comparing  the  first  generation  visibility 
model  formulation  for  ATj^.  with  the  FLIR92  formulation  for  MRTD  suggests  the  second 
generation  ATjj.  could  be  found  by  replacing  the  NETD  in  the  first  generation  formulation 
with  the  atvh  term  and  the  appropriate  directional  noise  components.  The  heuristic 
formulation  is; 


AT,,  = 


1  + 


2  , 


OJ 


(Et) 


OJ 


(5.15) 


where  the  atvh  term  is  formulated  as  in  Eq.  3.7.  In  this  formulation,  the  Ej  term  represents 
the  SNR  enhancement  brought  about  by  the  temporal  integration  of  the  eye  over  the 
displayed  signal,  since  the  signal  is  correlated  from  frame  to  frame  but  the  noise  is  not.  It 
is  given  by: 


E  =  _ - 

‘  CF, 


dot 


(5.16) 


The  threshold  SNR  can  be  set  to  give  the  desired  probability  of  resolution  [Ref.  7].  The 
atyji  term  is  the  random  pixel  noise  associated  with  the  device  as  measured,  or  as  predicted 
by  Eq.  3.7  [Ref.  16].  For  most  staring  systems  the  only  directional  noise  factor  of 
consequence  is  the  spatial  noise,  Oyii  [Ref.  16,  ARG-10].  The  remaining  directional  noise 
effects  are  not  included  in  the  analysis.  The  default  value  for  the  spatial  noise  is  postulated 
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to  be  0.40  a^yjj  as  given  in  Appendix  C.  Percepdcm  factors  for  the  horizontal  «nH  vertical 
directions  are  postulated  to  be  not  applicable  in  the  low  frequency  limit  [Ref.  9].  If  the 
values  of  and  Gy^  are  available  from  measurement  data,  Eq.  5.15  can  be  evaluated 
directly.  If  this  data  is  not  available,  Gtyj,  can  be  estimated  using  Eq.  3.9,  and  the  default 
value  can  be  used  for  Oyi,. 

Using  this  formulation,  the  minimum  threshold  contrast  fw  the  Mitsubishi  system 
is  calculated  to  be  0.0381  Celsius.  For  the  Amber  system,  the  heuristic  rfllr-iilntinn  yields 
0.00857  Celsius.  Comparing  these  values  to  the  ones  given  in  Table  5.1  reveals  that  the  lab 
measured  values  do  not  agree  with  this  formulatimi.  TTie  heuristic  formulation  of  Eq.  5.15 
gives  threshold  values  well  below  those  measured.  It  is  postulated  that  the  eiror  is 
introduced  in  the  bandwidth  correction  factor,  because  this  is  not  easy  to  define  for  second 
generation  staring  systems.  The  noise  characteristics  of  the  two  dimensional  staring  array 
with  its  associated  sampling,  clock-out,  and  aliasing  problems  are  ^parently  mwe 
complicated  than  is  given  in  the  simple  heuristic  formulation.  A  more  complete  prediction 
for  the  minimum  threshold  contrast  value  is  a  potential  subject  for  further  analysis. 

2.  Analysis  for  Objective  Minimum  Threshold  Contrast 

The  objective  formulation  for  AT^j.  is  required  for  systems  without  a  human 
observer  in  the  loop.  A  device  such  as  an  ATR  will  have  its  own  value  of  threshold  input 
contrast,  even  when  the  same  US  is  used.  As  the  data  presented  in  Figs.  4. 1 1, 4.12,  and 
4. 13  suggest,  the  ATR  system  experiences  a  degradation  in  contrast,  as  measured  by  the 
SNR,  with  inCTeased  spatial  frequency  in  a  manner  similar  to  that  experienced  by  a  human 
observer.  This  suggests  that  the  model  can  be  applied  equally  well  to  an  ATR  system,  if 
the  ^propriate  minimum  threshold  contrast  value  rawlrf  be  found. 

The  most  reliable  means  to  determine  the  minimum  threshold  input  contrast  value 
for  an  ATR  device  is,  of  course,  to  measure  it.  As  Fig.  4.1 1  demonstrates,  this  value  can 
be  much  higher  than  the  threshold  input  contrast  resolvable  by  a  human  observer  for  the 
same  nominal  ouqjut  signal  to  noise  ratio.  As  observed  in  the  laboratory  measurements,  in 
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order  to  achieve  an  SNR  of  6.0  as  measured  on  the  oscilloscope,  the  temperature  difference 
had  to  be  greatly  increased  above  that  required  for  a  human  to  detect  the  pattern  in  the 
display.  The  SNR  value  of  6.0  was  chosen  arbitrarily  because  it  is  nominally  the  SNR 
required  for  100%  probability  of  detection  for  a  human  observer  [Ref.  28].  As  indicated 
by  Fig.  4.10,  the  ATR  used  in  the  simulation  probably  could  have  resolved  the  target  weU 
before  this  SNR  was  achieved.  It  is  possiblejiowever,  that  a  given  device  may  require  an 
input  SNR  as  high  as  this  to  meet  its  recognition  performance  parameters  (e.g.,  low  false 
alarm  rate.)  The  fact  that  the  human  observer  can  resolve  a  target  when  the  oscilloscope 
measured  output  SNR  is  much  less  than  6.0  implies  either  that  the  actual  human  resolvable 
SNR  is  a  great  deal  less  than  6.0,  or  the  oscilloscope  itself  significantly  degrades  the  ouqjut 
signal  For  example,  at  a  spatial  frequency  of  0.5  cy/mrad,  the  human  observer  could 
resolve  the  four  bars  with  100%  probability  of  resolution  at  an  MRTD  of  about  0.25  Celsius 
(Fig.  4.6).  To  achieve  an  SNR  (nominal)  corresponding  to  the  same  detection  probability, 
the  ATR  device  required  an  MRTD  of  about  3.75  Celsius  (Fig.  4.13).  However,  regardless 
of  the  actual  threshold  values  of  output  SNR  required  for  the  human  and  ATR  to  resolve 
the  target,  the  fact  that  these  threshold  values  may  be  different  is  an  essential  element  of 
VISMODn.  Once  a  resolution  threshold  for  an  ATR  device  has  been  established, 
performance  prediction  can  be  easily  obtained  using  the  visibility  model  concepts. 

Figure  4.1 1  implies  an  objective  ATj^.  in  the  low  frequency  limit  for  the  simple 
ATR  simulation  conducted  to  be  about  4  to5  degrees  Celsius,  about  65  times  larger  than  the 
subjective  AT^^  of  around  0.07  Celsius.  ITiis  demonstrates  the  difficulty  in  develc^ing  an 
ATR  system  that  can  rival  a  human  observer  for  resolution  tasks.  Figure  4.13  demonstrates 
an  almost  linear  falling  off  in  SNR  measured  as  AT  is  decreased.  This  suggests  an 
additional  MTF  parameter  may  be  required  for  the  electronics  of  the  ATR  device  itself. 
Figure  4.12  confirms  that  in  the  low  frequency  limit  the  SNR  approaches  a  threshold  value 
for  a  given  temperature.  If  the  threshold  SNR  for  the  device  could  be  determined  by 
measurement,  p«:rhaps  of  some  electronic  test  signal,  then  perhaps  this  data  could  be  used 
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in  the  heuristic  formulation  of  an  objective  ATj^.  Once  this  formulation  is  completed  for 

an  individual  ATR  device,  perhaps  the  results  could  be  extended  to  entire  classes  of 
systems. 

The  process  of  finding  the  appropriate  threshold  input  contrast  value  for  an  ATR 
device  is  an  interesting  question,  and  deserves  further  analysis.  Since  the  framework  of  the 
VISMODn  is  already  in  place,  this  could  open  the  door  to  an  objective  measure  of 
resolution. 

D.  RESULTS 

Based  on  laboratory  measured  subjective  ATj^  for  the  TIS  systems  used  (Table  5.1), 
and  the  contrast  transference  parameters  calculated  by  VISMODn,  the  following  MRTD 
plots  were  obtained.  Horizontal  and  vertical  MRTD  curves  were  generated  by  the  model, 
then  the  values  were  geometrically  averaged  to  produce  a  two  dimensional  MRTD.  These 
plots  are  compared  to  FLIR92  predictions  and  measured  laboratory  results  in  the  next 
ch^ter. 

Figure  5.9  shows  tiie  VISMODH  predicted  MRTD  curve  for  the  Amber  system. 
Figure  5.10  shows  the  VISMODH  prediction  fw  the  Mitsubishi  system.  The  vertical 
MRTD  for  these  two  systems  was  calculated  by  rotating  the  target  pattern  by  90  degrees. 
In  each  case,  the  measured  value  of  AT^^  was  used.  The  Amber  MRTD  prediction  is  very 
similar  in  both  v^tical  and  horizontal  directions  because  of  the  symmetry  in  the  detector 
elements  and  the  detector  array.  The  slight  difference  that  does  exist  may  arise  from  the 
assumed  clock-out  pattern  for  the  device.  In  the  Mitsubishi  system,  the  difference  between 
the  vertical  and  horizontal  predictions  is  larger.  For  both  systems,  VISMODH  predicts  a 
severe  cut-off  at  approximately  1  cy/mrad.  Near  this  point,  the  resolution  limit  of  both 
systems  is  reached.  As  is  shown  in  the  next  chapter,  this  corresponds  weU  with  observed 
results. 
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MRTD  I  MRTD 


Figure  5.9.  VISMODII  predictions  for  Amber  system  MRTD 


Figure  5.10.  VISMODII  predictions  for  Mitsubishi  system  MRTD 
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VI.  DATA  ANALYSIS  AND  CONCLUSIONS 


This  chapter  is  a  comparative  analysis  of  the  VISMODII  model.  The  model  is 
compared  to  the  actual  laboratory  measurement  data  recorded  in  Chqjter  IV  and  Appendix 
D;  and  the  predictions  of  the  FLJR92  model  presented  in  Appendix  C.  This  comparative 
analysis  demonstrates  the  validity  of  the  visibility  model  concepts  applied  to  second 
generation  systems.  Since  the  two  systems  used  in  the  latHxatory  are  qtiite  different  in  their 
capabilities  and  parameters,  the  comparison  also  demonstrates  the  suitability  of  VISMODII 
for  a  wide  range  of  FPA  imagers. 

After  VISMODII  predictions  are  validated  against  FLIR92  and  measured  data,  an 
e^loration  of  the  effects  of  various  second  generation  modeling  considerations  is 
accomplished.  In  this  second  section,  VISMODII  is  modified  to  study  the  result  of 
including  or  neglecting  various  of  the  effects  presented  in  Chapter  m.  The  model’s 
predictions  with  and  without  aliasing,  for  example,  are  compared  to  measured  data.  These 
comparisons  demonstrate  the  degree  of  significance  these  effects  have  on  the  predicted  and 
measured  performance  of  the  device.  The  chapter  closes  with  some  conclusions,  and 
suggested  directions  for  further  research. 

A.  COMPARISON  OF  PREDICTIVE  RESULTS  TO  MEASUREMENT 

The  following  predictive  plots  were  generated  for  horizontal,  vertical,  and  two 
dimensional  MRTD  by  VISMODII  and  by  FLIR92  from  the  data  contained  in  Appendix 
A.  The  VISMODII  predictions  also  use  the  laboratory  measured  subjective  AT^^  for  the 
TIS  systems  used  (Table  5.1).  The  lab  data  two  dimensional  MRTD  figure  is  calculated 
by  geometrically  averaging  the  measured  horizontal  and  vertical  results,  in  the  same 
manner  that  the  other  two  dimensional  MRTD  performance  curves  were  obtained.  All 
three  plots  appear  together  for  comparison  purposes  for  each  of  the  systems  used. 

Figure  6. 1  compares  the  VISMODII  predicted  MRTD  curve  for  the  Ambo*  system 
with  the  measured  results  and  the  FLIR92  predicted  curve.  Figure  6.2  shows  the 
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VISMODn  prediction  for  the  Mitsubishi  system,  compared  to  measured  results  and 
FLIR92  predictions  for  that  system. 


Figure  6.1.  Amber  system  two  dimensional  MRTD  predictions 


In  Fig.  6. 1,  it  is  shown  that  the  predictive  models  give  quite  different  performance 
predictions  for  this  device.  The  FLIR92  model  {qjpears  quite  optimistic  compared  to 
measured  results.  The  primary  cause  of  this  mismatch  is  conjectured  to  be  the  D* 
parameter  for  other  than  PtSi  detectors.  Since  FLIR92  is  designed  primarily  for  PtSi 
detector  arrays,  it  may  be  somewhat  less  reliable  for  predictions  for  devices  that  use  other 
materials.  The  Amber  system  is  an  InSb  array,  with  a  D*  an  order  of  magnitude  higher  than 
most  PtSi  airays. 
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As  explained  in  Appendix  C,  the  FLIR92  predictions  also  stop  at  the  calculated 
system  Nyquist  frequency  (about  1  cy/mrad).  The  actual  laboratory  measurements  suggest, 
however,  that  resolution  is  stUl  possible  beyond  this  frequency.  VISMODH  extends 
prediction  beyond  this  point  by  incorporating  aliasing  effects  in  the  model.  Figure  6. 1  does 
indicate  that  the  VISMODH  model  provides  MRTD  predictions  that  are  at  least  as  good  as 
FLIR92  for  the  Amber  system. 


Figure  6.2.  hfitsubishi  system  two  dimensional  MRTD  predictions 
As  shown  in  Fig.  6.2,  the  predictions  of  the  two  models  are  much  closer  for  the  PtSi 
array  used  in  the  Mitsubishi  system.  This  gives  credence  to  the  idea  that  FL1R92  is  more 
reliable  for  predicting  performance  for  PtSi  arrays  than  fw  other  types.  Both  models  give 
quite  reasonable  predictions  for  low  spatial  frequencies.  The  FLIR92  predictions, 
however,  do  appear  to  go  to  ztf  o  in  the  low  frequency  limit.  The  measured  data  and  the 
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VISMODn  predictions  do  not.  The  figure  shows  that  there  is  a  sharp  increase  in  measured 
MRTD  at  around  0.9  cy/mrad.  This  cutoff  is  predicted  by  VISMODII  which  includes 
aliasing  effects  that  become  significant  near  this  spatial  frequency.  As  observed  in  Chapter 
rV,  this  region  also  marks  the  limits  of  the  resolution  of  the  system.  Beyond  this  point,  a 
single  bar  in  the  bar  pattern  spans  less  than  one  pixel  on  the  display.  The  four  bars  blend 
together,  making  resolution  of  each  an  impossibility.  It  is  suggested  by  the  data  that  the 
pixel  resolution  limit  of  the  system  is  not  perfectly  predicted  by  either  model.  It  is  clear 
from  both  Fig.  6.1  and  Fig.  6.2  that  the  visibility  model  concepts  can  be  used  with  some 
success  in  predicting  the  performance  of  second  generation  systems. 

B.  EXPLORATION  OF  THE  MODEL 

This  section  is  a  brief  exploration  of  the  visibility  model  and  the  impact  of  the 
second  generation  modeling  considerations  presented  in  Chapter  IQ.  Although  the 
modeling  concepts  have  certain  mathematical  interest  and  validity,  it  is  also  valuable  to  see 
if  their  effects  are  significant  in  the  actual  prediction  of  device  performance. 

Figures  6.3  and  6.4  present  the  VISMODQ  predictions  for  the  two  systems  for  both 
vertical  and  horizontal  measurement.  The  VISMODH  predictions  appear  to  be  quite 
accurate,  closely  paralleling  measured  results.  Because  of  the  assumed  vertical  clock-out 
scheme  of  the  Amber  system,  the  predictive  performance  in  the  vertical  and  horizontal 
directions  are  slightly  different.  Since  the  detectors  in  this  system  are  square,  this  is  the 
only  effect  that  is  expected  to  differ  between  the  two  orientations.  The  measured  data 
suggests  that  there  is  a  slight  difference  in  the  performance  of  the  Amber  system  in  the  two 
directions.  This  difference  is  predicted  by  VISMODQ. 

For  the  Mitsubishi  system,  the  model  gives  predictive  results  that  very  closely 
match  the  performance  of  the  device.  In  this  case  their  is  a  clear  distinction  between  the 
two  orientations  as  the  detectors  are  rectangular,  not  square.  This  fact,  plus  the  clock-out 
effect  cause  the  vertical  MRTD  performance  for  this  system  to  be  much  poorer  than  the 
horizontal.  VISMODn  predicts  this  rapid  decline  in  resolvability  in  the  vertical  direction. 
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The  effect  is  predominantly  due  to  the  assumed  vertical  clock-out  pattern  and  the 
difference  in  sampling  frequencies  caused  by  the  rectangular  shape  of  the  detector  cells  in 
the  focal  plane  array.  Figure  6.4  suggests  that  both  the  clock-out  process  and  the  aliasing 
effects  are  properly  modeled  for  this  device.  It  also  demonstrates  again  the  validity  of  the 
visibility  model  concepts. 
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Figure  6.4.  Mitsubishi  system  horizontaJ/vertical  predictions 


The  next  two  plots  demonstrate  the  effects  of  aliasing  and  sample-scene  phasing 
effects  on  the  predictive  model.  In  Fig.  6.5,  different  methods  of  including  sample-scene 
phase  effects  are  presented  and  compared.  In  Fig.  6.6,  the  effect  of  ignoring  aliasing  effects 
on  both  horizontal  and  vertical  MRTD  performance  is  demonstrated. 


no 


MRTD,  Celsius  |  MRTD,  Celsius 


Figxire6.5.  Mitsubishi  system  sample-scene  phase  effects 


Figure  6.6.  Mitsubishi  system  aliasing  impact  on  predicted  MRTD 
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Figure  6.5  demonstrates  the  effect  of  sample-scene  phasing  (ssp)  on  the  predictive 
model.  Four  curves  are  shown.  The  predicted  two  dimensional  MRTD  curve  with  no 
sample-scene  phase  effects  coincides  exactly  with  the  curve  predicted  when  the  sample- 
scene  phase  effect  is  included  as  multiplication  by  a  complex  exponential  as  given  by  Eq. 
3.3 1 .  This  indicates  that  multiplication  by  an  exponential  does  not  have  a  measurable  effect 
on  performance  prediction  and  could,  in  practice,  be  reasonably  ignored. 

A  second  means  of  modeling  sample-scene  phase  effects  is  to  include  an  additional 
MTF  in  the  image  formation  filter  [Ref.  16].  This  is  the  method  used  in  FLIR92,  as 
discussed  in  Appendix  C.  This  MTF,  when  included,  brings  the  predicted  MRTD  curve 
much  closer  to  measmed  results.  This  is  probably  because  the  original  prediction  curve  is 
too  optimistic.  This  method  of  modeling  may  impose  too  severe  constraints  on  predicted 
system  performance  as  it  has  a  large  effect  on  the  predictive  outcome  of  the  model.  This 
large  effect  intuitively  seems  out  of  proportion  to  the  actual  effects  of  sample  scene 
phasing.  In  all  cases,  the  models  converge  at  low  frequencies.  In  the  low  frequency  case, 
the  objects  to  be  resolved  are  larger  and  cover  more  detector  elements  in  the  array.  This 
makes  the  relative  position  between  the  image  on  the  detector  plane  and  the  centers  of  the 
detector  elements  themselves  less  important. 

Figure  6.6  demonstrates  the  impact  of  failing  to  include  aliasing  effects  in  the 
predictive  model.  As  shown,  the  prediction  curves  without  aliasing  are  quite  a  bit  more 
optimistic  than  the  predictions  that  include  aliasing  effects .  Aliasing  effects  are  also  shown 
to  be  present  even  below  the  system  Nyquist  frequency.  The  effects  of  aliasing  are  clearly 
present  at  spatial  frequencies  as  low  as  0.6  cy/mrad.  This  suggests  that  the  FLIR92  method 
of  stopping  predictions  at  the  Nyquist  frequency  is  inadequate.  For  accurate  predictive 
results,  aliasing  effects  must  be  included  at  even  low  frequencies. 

The  effects  of  aliasing  are  also  shown  to  affect  the  sh^)e  of  the  curves.  Whereas 
the  imaliased  curves  are  smooth,  corresponding  to  the  general  Gaussian  roU-off  of  the 
image  formation  and  reconstruction  filters,  the  aliased  ones  include  some  high  frequency 
‘ripple’.  This  is  consistent  with  the  modeling  of  aliasing  as  demonstrated  in  Chapter  HI. 
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The  spurious  aliasing  term  consists  of  relatively  higher  frequency  components,  creating  the 
‘ripple’  effect.  This  may  help  explain  some  of  the  ripple  effect  that  spears  in  the 
laboratory  measured  curves  as  well. 

C.  CONCLUSIONS 

The  laboratory  validation  of  the  VISMODII  predictive  results  is  an  important 
milestone.  The  results  obtained,  although  limited  in  scope,  do  indicate  that  an  MRTD 
predictive  model  based  on  a  minimum  threshold  contrast  and  a  contrast  transference 
parameter  can  provide  reasonably  accurate  results.  The  visibility  model,  then,  is  confirmed 
as  a  simple  yet  accurate  means  of  predicting  FUR  perfcxmance.  It  is  predicted  from  these 
limited  results  that  a  more  robust  analysis  would  confirm  the  viability  of  the  visibility 
model  concepts. 

The  power  of  the  model  developed,  however,  is  that  it  can  achieve  prediction 
accuracy  on  a  par  with  other  second  geno'ation  models  without  making  complicated  eye! 
brain  recognition  process  assumptions.  VISMODII,  although  computationally  and 
conceptually  simple,  is  also  more  complete  than  some  other  models  in  its  treatment  of  the 
entire  aliasing/scene  phasing  process.  As  seen  in  this  chapter,  these  effects  cannot  be 
ignored  even  at  low  frequencies.  The  implementation  of  three  dimensional  noise  and 
clock-out  frequency  effects  is  also  a  valuable  addition  to  a  predictive  model. 

The  move  toward  objective  ATR  type  systems  is  well  underway,  and  is  not  likely 
to  change  course.  Because  the  visibility  modeling  process  makes  no  assumptions  about  the 
eye/brain  recognition  process,  it  could  easily  be  used  to  predict  performance  for  ATR 
devices  as  well  as  human  observer  systems.  This  may  be  the  most  significant  result  of  the 
visibility  model.  This  model  clearly  demonstrates  the  feasibility  of  an  objective  MRTD 
concept  based  on  a  contrast  transference,  and  serves  as  a  possible  basis  for  frirther 
exploration  of  the  whole  ATR  objective  MRTD  modeling  process.  An  accepted  definirinn 
of  the  ‘objective’  MRTD,  however,  still  needs  to  be  foimd.  A  more  desirable  course  of 
action  may  be  the  development  of  a  replacement  figure  of  merit. 
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It  is  clear  from  the  results  obtained  that  MRTD  performance  prediction  models  for 
second  generation  systems  that  are  extrapolations  of  first  generation  concepts  that  ignore 
many  second  generation  effects  will  probably  prove  to  be  inadequate.  VISMODII  is 
hopefully  a  bridge  that,  on  one  hand,  is  backwards  compatible  with  the  community  standard 
figure  of  merit,  the  subjective  MRTD;  and,  on  the  other  hand,  is  a  step  in  the  development 
of  a  new  and  more  objective  resolvability  criterion.  It  is  hoped  that  it  will  be  useful  in 
further  development  in  this  direction. 

D.  DIRECTIONS  FOR  FURTHER  RESEARCH 

The  wide  scope  of  the  thermal  imaging  process  makes  it  a  fascinating  topic. 
Elements  of  physics,  optics,  electronics,  mathematics,  and  visual  psycho-physics  are  aU 
present.  Additionally,  computer  imaging,  digital  signal  processing  and  electrical 
engineering  are  aU  present  in  various  degrees.  In  following  one  path  through  this 
interdisciplinary  subject  matter,  it  is  not  possible  to  cover  all  topics  of  interest.  The 
possibilities  for  further  research  are  almost  endless.  A  few  specific  items  of  interest  are 
provided  as  possible  directions  for  future  research. 

VISMODn  could  be  enhanced  by  the  addition  of  several  features.  The  model 
currently  only  calculates  exactly  horizontal  and  exactiy  vertical  MRTD’s.  A  predictive 
model  in  the  future  should  be  able  to  predict  performance  for  all  angles.  Along  with  the 
increased  flexibility,  VISMODII  could  benefit  from  more  efficient  computer  coding  and  a 
better  user  interface.  It  could  include  a  more  complete  MTF  analysis,  and  a  more  complete 
heiuistic  formulation  of  the  oitical  threshold  contrast. 

The  process  of  finding  the  appropriate  objective  threshold  input  contrast  value  for 
an  ATR  device  is  an  interesting  question,  and  deserves  further  analysis.  Since  the 
framework  of  the  VISMODII  is  already  in  place,  this  could  open  the  door  to  a  new 
objective  measure  of  resolution.  A  more  complete  analysis  of  the  subjective  MRTD’s 
^plication  to  ATR  devices  would  be  helpful  in  this  regard. 
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More  laboratory  validation  is  required.  Laboratory  measurements  for  more 
complex  ATR  devices  could  be  obtained  and  conqjared  to  subjective  results.  This  would 
help  determine  the  framework  for  an  objective  resolution  oiterion  and  figure  of  merit. 

Finally,  VISMODH  still  refers  to  a  four-bar  target  pattern  (as  do  other  state-of-the- 
art  models).  To  address  the  application  of  systems  to  real  field  situations  and  the  detection 
of  real  targets,  i.e.,  ships,  tanks,  and  people,  it  would  be  valuable  to  explore  the  possibility 
of  replacing  the  standard  four-bar  test  with  one  requiring  the  discernment  of  spatial  detail 
or  patterns  from  a  complex  or  cluttered  background  scene. 
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APPENDIX  A.  THERMAL  IMAGING  SYSTEM  PARAMETERS 
This  appendix  contains  the  physical  system  parameters  used  in  producing  MRTD 
prediction  plots  and  taking  laboratory  measurements.  The  sample  first  generation  system 
was  chosen  to  coincide  with  the  sample  first  generation  system  detailed  in  Lloyd  [Ref.  3]. 
The  Amber  and  Mitsubishi  systems  are  second  generation  staring  focal  plane  array  devices, 
representative  of  many  of  the  commercially  available  systems  to  be  foimd.  These  two 
systems  w^e  also  used  to  make  laboratory  measurements.  ?<»*  the  two  second  generation 
systems,  the  data  is  presented  in  the  same  format  as  required  by  the  FLIR92  program.  The 
data  listed  for  the  Amber  system  was  obtained  from  the  User’s  Manual  [Ref.  38].  The  data 
for  the  Mitsubishi  system  was  obtained  from  the  user’s  manual  [Ref.  40],  and  from 
Mitsubishi  Electronics  America,  Cypress,  CA  [Ref.  41]. 


A.  SAMPLE  FIRST  GENERATION  SYSTEM 


Focal  length . 

Diameter  of  lens . 

F/number . 

Detector  element  size . 

Horizontal  angular  subtense 
Vertical  angular  subtense  . . 
Spectral  Bandpass . 

D* . 

Frame  rate . 

Scan  rate  format . 

Number  of  scan  columns  . . 

Number  of  scan  lines . 

Interlace . 

Scan  efficiency . 

Detector  vertical  spacing. . . 


50  mm 
20  mm 
25 

5mmx5  mm 
1  mrad 
1  mrad 
8  [im  -  ll{im 

2.0x10^°  cm  Hz°-^/W 
30  Hz 

60  fields/sec 

150 

300 

2tol 

.0.64 

1  mrad 
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400nirad 


Horizontal  Field  of  View 
Vertical  Field  of  View . 300  mrad 

Detector  dwell  time . 2.67  xlO'^  sec 

Horizontal  scanning  velocity . 37453.2  mrad/sec 

3-dB  Electronic  roll-off  frequency . 18716.6  Hz 

CRT  spot  size . 0.25  mrad 

Reference  bandwidth  for  NETD . 29.4  kHz 

Barkgrovmd  temperature . 300  K 

Ta  ?et  wavelength  (monochromatic) . 10  pm 

Optical  efficiency  of  the  viewer . 0.8 

Threshold  SNR . 4.5 

Eye  integration  time . 0.2  sec 

B.  AMBER  ENGINEERING  MODEL  AE4128 

Laboratory  temperature . 300  K 

Backgroimd  temperature . 294  K 

BLIP  performance . YES 

Spectral  cut-on . 3.0  |lm 

Spectral  cut-off . 5.0  pm 

F/  number . 3.0 

Focal  length . 10.0  cm 

Optical  transmittance . 0.95 

Frame  rate . 109  Hz 

Detector  active  horizontal  dimension . 40  pm 

Detector  active  vertical  dimension . 40  pm 

5.9  xlO^^  cm  Hz®-^/W 


D* . 

Integration  time 
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8887.615  psec 
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Number  of  columns  in  detector  array 

Number  of  rows  in  detector  array . 128 

Detector  cell  horizontal  dimension . 50  [im 

Detector  cell  vertical  dimension . 50  |im 

Number  of  active  CRT  lines . 480 

Display  brightness . 10.0  mLamberts 

Display  height . 17.78  cm 

Display  viewing  distance . 88.9  cm 

Threshold  SNR . 6.0 

Eye  integration  time . 0.2  sec 

3D  noise  level  (used  in  FLIR92,  see  Appendix  C) . MOD 

C.  MITSUBISHI  M500  THERMAL  IMAGER 

Laboratory  temperature . 300  K 

Background  temperature . 294  K 

BLIP  performance . YES 

Spectral  cut-on . 3.0  pm 

Spectral  cut-off . 5.0  pm 

F/ number . 1.4 

Focal  length . 5.0  cm 

Optical  transmittance . 0.95 

Frame  rate . 60  Hz 

Detector  active  horizontal  dimension . 16.24  pm 

Detector  active  vertical  dimension . 12.49  pm 

D* . 5.0x10^°  cm  Hz°-^/W 

Integration  time .  16145.833  psec 

Number  of  columns  in  detector  array . 512 
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512 


Number  of  rows  in  detector  array . 

Detector  cell  horizontal  dimension . 26  pm 

Detector  ceU  vertical  dimension . 20  jjm 

PtSi  emission  coefficient . 0.16  1/eV 

Schottky  barrier  height . 22  eV 

Number  of  active  CRT  lines . 480 

Display  brightness . 10.0  mLamberts 

Display  height . 27.94  cm 

Display  viewing  distance . 88.9  cm 

Threshold  SNR . 6.0 

Eye  integration  time . . . 0.2  sec 

3D  noise  level  (used  in  FLIR92,  see  Appendix  C) . MOD 
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APPENDIX  B.  RATCHES/LLOYD  CONVERSION  FACTOR 

The  Ratches  and  Lloyd  first  generation  MRTD  prediction  models  can  be  shown  to 
be  equivalent  with  the  addition  of  a  frequency  dependent  conversion  factor.  This 
conversion  factor  was  first  postulated  in  Ref.  9.  A  mwe  complete  derivation  of  this  factor 
is  contained  in  this  appendix. 

The  two  formulations  for  MRTD  given  by  the  Ratches  and  Lloyd  models  are 
presented  as  Eq.  2.8  and  Eq.  2.16  respectively.  These  formulations  are  repeated  here  for 
convenience; 

MRTDr= 


^ISNR^lj^NETD 


df  J  Jo 


2  2 


(B.l) 


r 


and. 


MRTDl  = 


0.66(SNRth,)(NETD)(fJ/  y.5 
(Af„)°-^H3y3(f)  ^FdotW 


(B.2) 

The  assumed  formulation  for  conversion  between  the  two  models  is  given  by: 

MRTDx, 


X  = 


MRTDt 


(B.3) 


Removing  the  terms  conunon  to  both  formulations;  namely,  SNRjj^  1^, 
NETD,MTF(f)  and  and,  recognizing  that  the  scan  velocity  is  given  by: 

V  =  —  ,and  (B.4) 

■'d 

Ayi  =  P,  (B.5) 
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yields  the  following: 


0.66Lf,-J_H^H^y3dfy 


(B.6) 


Since  the  bar  height  is  seven  times  the  width,  and  the  spatial  frequency  is  given  by 
the  inverse  of  the  spatial  period  (2W): 


Lf,  =  7W-^  =  |, 


n^f7 


8A7. 


=  0.66, 


(B.8) 


gives: 


Applying  an  imconventional  ‘simplification’: 

V7  =  ^, 

JWL 


(B.9) 


(B.IO) 


If  the  length  of  a  target  bar  in  the  vertical  direction  is  large  compared  to  the  system 
vertical  response  (which  is  almost  always  the  case)  then  the  vertical  transfer  function 
effects  can  be  ignored.  The  bar  (contrast),  in  effect,  is  undegraded  in  the  vertical  direction. 
Then, 


r  S(fx)  2  2 


(B.ll) 


The  post-detector  transfer  functions  are  one-dimensional  in  x,  and  therefore  the 


vertical  system  response  can  be  set  to  one  for  these  terms  as  well: 
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J„  Hi.e,HX<tfy  =  1  • 


(B.12) 


which  yields  the  final  form  of  the  correction  factor; 


hLiHwHX 


(B.13) 
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APPENDIX  C.  FLIR92 


Several  second  generation  models  have  been  developed  incorporating  the  modeling 
considerations  of  Chapter  El  to  varying  degrees.  The  most  notable  of  these  is  FLIR92,  a 
product  of  the  U.S.  Army’s  Night  Vision  and  Electronic  Sensors  Directorate  (NVESD). 
[Refs.  16,24]  The  NVESD  is  a  direct  descendent  of  the  previously  named  Night  Vision 
Laboratory  (NVL).  FLIR92  is  the  de  facto  standard  for  second  generation  modeling 
efforts,  and  a  key  predictor  used  to  evaluate  any  US  introduced  for  DOD  consideration. 
FLIR92  is  a  computer-based  thermal  imaging  system  MRTD  and  MDTD  predictor 
released  in  1992.  It  is  a  direct  descendent  of  the  1975  NVL  model,  and  a  refinement  of  the 
earlier  released  FLIR90.  Like  its  predecessors,  FLIR92  is  a  computer  based  predictor, 
developed  to  aid  the  Army  in  analyzing  potential  TIS  systems  for  various  applications. 
Available  in  executable  code  for  PC’s  or  UNIX,  it  is  designed  to  handle  staring  imagers  and 
parallel  scaiming  systems,  as  well  as  first  generation  serial  scanning  systems.  It  is  arable 
of  providing  MRTD,  MDTD,  and  NETD  predictions  for  all  of  the  above  systems.  Unlike 
previous  models,  FLIR92  is  fully  configuration  managed,  so  model  improvements  and 
adjustments  can  be  incorporated  through  controlled  revisions.  It  is  a  'static’  model,  it  does 
not  account  for  target  acquisition  or  tracking  problems.  Also,  it  is  limited  to  imaging 
systems  operating  in  the  thmnal  region  of  the  spectrum. 

Like  the  1975  model,  FLIR92  is  based  on  a  signal  to  noise  analysis  degraded  by  a 
system  MTF.  The  MTF’s  incorporated  are  more  sophisticated  and  flexible  than  the  earlier 
models,  but  the  basic  application  of  linear  systems  theory  remains  unchanged  from  1975. 
The  model  has  'generic’  MTF’s  built  in  for  default  component  analysis,  but  also  allows  the 
user  the  flexibility  of  inputting  measured  MTF’s  from  a  particular  sub-system  component, 
if  desired.  The  most  revolutionary  aspect  of  the  FLIR92  model  is  its  treatment  of  noise. 
The  model  incorporates  the  full  3-D  noise  analysis  scheme  as  discussed  in  Ch^ter  m.  This 
noise  analysis  results  in  correction  factors  to  be  applied  to  the  votical  and  horizontal 
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MRTD  calculations.  The  vertical  MRTD  predictions  from  FLIR92  are  considered  reliable, 
an  improvement  over  earlier  models. 

FLIR92  compromises  on  the  treatment  of  sampling  in  imaging  systems  by  cutting 
off  MRTD  predictions  at  the  system  Nyquist  frequency.  On  one  hand,  this  is  conservative 
because  significant  information  is  often  available  above  the  Nyquist  frequency,  although  it 
may  not  be  perfectly  resolved.  On  the  other  hand,  this  liberally  ignores  the  effects  of 
aliasing  felt  at  frequencies  below  Nyquist.  Finally,  in  FLIR92,  the  eye  is  treated  as  a 
synchronous  integrator  instead  of  a  matched  filter.  This  method  gives  nearly  the  same 
results  as  the  matched  filter  model  for  periodic  targets,  but  is  much  easier  to  model  [Ref. 
16].  FLIR92’s  treatment  of  3-D  noise,  including  MRTD  correction  factors  and  eye/brain 
integration  factors  is  contained  in  Chapter  HI.  This  t^pendix  describes  FLIR92’s  treatment 
of  MTF  modeling,  sampling  and  aliasing,  and  MRTD/MDTD  correction  factors. 
Following  these  descriptions,  the  input  data  files  for  the  Amber  and  Mitsubishi  systems  are 
included.  Finally,  the  output  of  FLIR92  for  both  of  the  second  generation  systems  used  in 
the  laboratory  is  also  presented. 

A.  MTF  ANALYSIS 

The  MTF  analysis  of  FLIR92  is  more  complex  than  in  its  predecessor.  Like  the 
older  models,  FLIR92  groups  the  individual  component  MTF’s  into  categories;  pre-filter, 
temporal  post-filter,  and  spatial  post-filter.  Each  category  is  made  up  of  a  cascade  of 
individual  component  MTF’s.  In  each  case,  individual  component  MTF’s  may  be  either 
entered  in  exactly,  or  may  be  ^proximated  by  a  default  model.  Most  of  the  MTF’s  listed 
are  optional,  while  some  apply  only  to  specific  cases.  If  the  MTF  does  not  apply  to  the 
particular  system,  its  value  is  set  to  1.0.  Each  category  also  allows  the  user  to  input  a 
‘spare’  MTF  to  make  the  category  MTF  a  better  match  for  the  modeled  system.  The 
subscript  ‘z’  indicates  that  the  variable  exists  in  both  the  vertical  and  horizontal  directions, 
and  should  be  included  in  both  analyses  with  the  tqjpropriate  subscript  (v  or  h). 
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1.  Pre-niter  MTF 


The  pre-filter  MTF,  HpRE(f),  includes  components  of  the  system  from  the  target  to 
the  detector  array.  Components  such  as  system  optics,  detector  spatial  properties,  focal 
plane  array  (FPA)  integration,  and  image  motion  effects  are  included.  The  pre-filter  MTF 
is  analogous  to  the  image  formation  filter  presented  in  Ch^^ter  m.  The  pre-filter  MTF  is 
given  by: 

^PRe(^)  ~  ^opt^ogb^dct^di^ssp^ml^mr^ins^^)  ^  (C.l) 

where  the  individual  component  MTF’s  are  desoibed  in  Table  C.l. 


TABLE  C.l.  Pre-filter  MTF’s 


Symbol 

Component 

Hopt 

Optical  diffraction  limited 

Optical  geometric  blur 

Hdet 

Detector  spatial 

Hdi 

IFA  integration 

Hssp 

Sample-scene  phasing 

Linear  image  motion 

Har 

Random  image  motion 

Hjus 

Sinusoidal  image  motion 

The  first  of  these  elements  is  the  system  optics  MTF,  composed  of  a  diffraction 
limited  MTF  (assumes  cylindrical  symmetry): 

and  a  geometric  blur  MTF  accounting  for  optical  aberrations: 


Second  in  the  pre-filter  cascade  is  the  detector  spatial  MTF: 


H<le,(f)  = 


sinCnA^f) 

jiA/ 


(C.4) 


where  \  is  the  physical  dimension  of  the  individual  detector  element  in  either  the  vertical 
or  horizontal  direction. 

Scanning  systems  have  a  finite  detector  integration  time  which  is  accounted  for  by 
the  FPA  integration  MTF; 


Hdi(0 


sinCTTftVgtj) 


(C.5) 


where  is  the  finite  integration  time  of  the  detector,  and  Vj  is  the  scan  velocity.  Finally,  in 


the  pre-filter  cascade,  MTF’s  are  available  to  model  sample  scene  phasing,  and  image 
motion.  Image  motion  is  further  subdivided  into  linear,  sinusoidal,  and  random  motion 
MTF’s,  each  describing  a  relative  target  imager  motion.  For  stiU  target  modeling,  such  as 
in  a  laboratory  enAnronment,  all  of  these  are  set  to  1 .0.  They  can,  however,  aid  in  the  proper 
modeling  of  a  fielded  system  where  image  motion  or  scene  phasing  are  expected. 


2.  Temporal  Post-filter 

AU  of  the  pre-filter  MTF’s  are  spatial  frequency  dependent.  After  the  detector, 
there  are  both  temporal  and  spatial  frequency  degradation  effects.  Combined,  they  make 
up  the  image  reconstruction  filter  presented  in  Chq}ter  m.  In  FLIR92,  the  post-filter 
MTF’s  are  subdivided  into  temporal  and  spatial  components. 

The  temporal  post-filter  MTF  is  given  by; 

HTPF(f)  =  .  (C.6) 

and  is  made  up  of  the  individual  component  MTF’s  described  in  Table  C.2. 
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TABLE  C.2.  Temporal  Post-lMter  MTF’s 


Symbol 

Component 

Hdt 

Detector  temporal 

Hehp 

Electronics  low-frequency 

Help 

Electronics  high-frequency 

Heb 

Electronic  boost 

Each  of  these  individual  component  MTF’s  represents  a  temporal  degradation  of  the 
displayed  image.  The  temporal  post-Elter  is  used  for  scanning  systems  only,  in  the 
direction  of  scan.  It  is  not  ^prc^riate  for  staring  arrays,  or  for  directions  normal  to  the  scan 
direction.  For  staring  arrays,  this  filter  is  set  to  1 .0.  Eadi  of  these  MTF’s  is  given  below: 


(C.7) 


(C.8) 


(C.9) 

(C.10) 


3.  Spatial  Post-filter 

The  spatial  post-filter  models  the  system  “back  end”  [Ref.  16].  The  spatial  pxwt 
filter  is  given  by: 

HsPF(f)  =  .  (C.ll) 
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and  is  made  up  of  the  individual  component  MTF’s  contained  in  Table  C.3. 


TABLE  C.3.  Spatial  Post-filter  MTF’s 


Symbol 

Component 

^^eom 

Electro-optic  multiplexor 

Hdig 

Digital  filter 

Hd 

CRT  display 

^^ccd 

CCD  Charge  transfer 

^dsh 

Display  sample  and  hold 

Hcyc 

Limiting  eye/brain 

The  electro-optically  multiplexed  system  is  given  by: 


^  sin(7if6ied) 
(^fSied) 


(C.12) 


where  bjed  is  the  angular  subtense  of  an  individual  LED  element  (Of  course,  this  MTF  is 


only  included  for  electro-optically  multiplexed  systems.  It  is  set  to  1.0  for  systems  with 
only  electronic  multiplexing). 

The  model  incorporates  an  MTF  for  linear  phase  symmetrical  impulse  response 
digital  filters.  For  odd  N: 


(N-ll 

I  • 

i  =  0  ^ 


(C.13) 


for  even  N: 


Hdig(0  = 


(C.14) 


where  N  is  the  number  of  samples,  aj  is  the  filter  coefficient,  and  f^^  is  the  filter  cutoff 
frequency. 
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If  the  display  is  a  standard  CRT,  the  model  assumes  a  Gaussian  spot  MTF,  just  like 
earlier  MTF  models.  If  the  monitor  is  non-standard,  another  MTF  may  be  entered.  The 
Gaussian  spot  MTF  is  given  by; 


Hjj(f)  =  exp(-27iVf^)  .  (C.15) 

The  CCD  charge  transfer  efficiency  MTF  is: 

Hccd(f)  =  exp(^-N(l  -  e)(l  -  cos(^27tj^j) 

The  eye  sample  and  hold  MTF  is  given  by: 


Hdsh(f)  = 


sin(7i5f) 

n6f 


(C.17) 


Finally,  the  post-filter  spatial  MTF  includes  a  limiting  eye  MTF  based  on  the 
angular  subtense  of  the  eye.  This  is  a  function  of  the  ambient  light  level  and  the  system 
magnification; 


He,.(f)  =  .  (C.18) 

As  with  the  other  category  MTF’s,  a  spare  filter  is  also  available  if  the  above  transfer 
functions  do  not  adequately  describe  the  system. 


4.  System  MTF 

The  complete  system  MTF  is  given  by; 

Hsys(0  -  HpRE^TPF^SPF^^)  •  (C.19) 

This  MTF  is  used  in  system  calculations  of  the  MRTD  and  MDTD. 

The  system  noise  filter  is  defined  as  the  ovo-all  filter  which  acts  on  detector  noise. 
It  is  used  in  the  calculation  of  eye/brain  spatial  integration  effects  [Ref.  16].  It  is  given  by: 

Hnf(^)  “  ^di^chp^TPF^SPF^^)  •  (C.20) 
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B.  SAMPLING  EFFECTS 

The  literature  abounds  with  complex  mathematical  models  and  procedures  for 
accounting  for  sampling  in  imaging  systems  of  all  types  [Refs.  17-23],  Unfortunately,  most 
of  these  presentations  are  more  suitable  to  imderstanding  sampling  effects,  and  are  not 
amenable  to  incorporation  into  a  practical  predictive  model  like  FLIR92.  Unquestionably, 
this  area  requires  further  study.  Sampling  effects  are  rather  quickly  disposed  of  in  FLIR92 
by  the  rejection  of  any  frequencies  above  the  calculated  system  Nyquist  frequency.  No 
ouqjut  is  given  fc «  frequencies  above  this  cutoff.  Unfortunately,  the  insidious  effects  of 
aliasing  are  felt  below  this  threshold  as  well,  and  are  ignored  by  this  model.  FLIR92 
presupposes  that  aliasing  and  other  deleterious  sampling  artifacts  can  be  effectively 
eliminated  by  good  design.  It  is  true  that  frequencies  above  Nyquist  cannot  be  fully 
reconstructed  by  the  system.  Therefore,  at  these  frequencies,  MRTD  can  never  be  reached 
by  strict  definition.  FLIR92  does  not  choose  to  model  undersampled  frequencies  as 
aliasing  noise  in  the  current  version.  Instead,  for  frequencies  greater  than  the  calculated 
Nyquist  frequency,  the  systen  does  not  calculate  an  MRTD  at  all.  This  can  be  frustrating 
to  the  user  because  it  places  a  tight  bound  on  system  modeling,  and  appears  inconsistent 
with  the  fact  that  the  effects  of  aliasing  on  frequencies  below  cutoff  are  ignored.  The  only 
sampling  effect  considered  by  the  FLIR92  is  the  sample  scene  phasing  effect  included  in 
the  pre-filter  MTF.  This  MTF  is  inserted  to  accoimt  for  degradation  caused  by  the  scene 
being  projected  onto  the  detector  array  in  a  less  than  optimum  position.  Use  of  this  feature 
is  optional. 

C.  SYSTEM  NOISE 

In  FLIR92,  the  modeling  of  each  of  the  seven  noise  components  is  implemented  by 
one  of  two  methods.  The  process  of  predicting  the  directional  noise  terms  for  a  particular 
system  from  simple  system  parameters  is  difficult  at  best,  and  calls  for  some  flexibility  in 
modeling  methods.  FLIR92  provides  this  flexibility.  The  first  (default)  method  involves 
scalmg  each  of  the  noise  factors  to  the  random  pixel  noise.  This  method  selects  a  scaling 
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factor  for  each  of  the  other  six  noise  components  referenced  to  the  value  for  a^yj,.  The  value 
for  ajyii  is  calculated  in  a  manner  analogous  to  the  method  used  in  first  generation  models 
to  calculate  the  NETD,  and  is  given  as  Eq.  3,9.  The  default  scaling  factors  used  based  on 
this  value  of  atyji  depend  on  the  type  of  system  being  modeled,  and  are  derived  from  a 
series  of  measurements  made  by  NVESD  with  several  difrerent  system  types  [Ref.  16]. 
Table  C.4  shows  the  default  value  for  staring  systems,  and  Table  C.5  shows  the  default 
values  used  for  scanning  systems.  Note  the  default  values  far  the  scanning  system  are 
selected  by  choosing  a  relative  noise  level;  either  low,  moderate,  or  high.  Because  the 
system  noise  sources  add  in  quadrature,  only  the  most  significant  noise  components  are 
given  scale  values.  The  remaining  directional  noise  components  are  set  to  zero. 

TABLE  C.4.  Default  scale  factors  for  staring  systems 
Noise  component  E>efault  value 

CTvh  .40 

TABLE  C.5.  Default  scale  factors  for  scanning  systons 
Noise  component  low  noise  moderate  noise  high  noise 
a,v  .25  .75  To 

ay  .25  .75  1.0 

The  second  way  to  implement  the  3-D  noise  components  is  to  enter  actual  measured 
values  if  they  can  be  obtained.  The  measurement  procedure  was  presented  by  D’Agostino 
in  1991  [Ref.  13].  Although  this  will  give  mme  accurate  predictions,  it  is  obviously 
difficult  to  measure  these  values. 
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D.  MRTD  PREDICTION 


FLIR92  uses  the  MTF  models,  noise  data,  and  eye/brain  spatial  and  temporal 
integration  factors  to  calculate  a  predicted  MRTD  in  both  the  horizontal  and  vertical 
directions.  The  correction  factors  used  are  given  in  Chapter  HI.  FLIR92  takes  the 
geometric  mean  of  the  horizontal  and  vertical  MRTD  values  to  give  a  two  dimensional 
MRTD  value.  All  three  values  for  MRTD  are  provided  in  the  ou^ut. 

E.  SYSTEM  OUTPUT 

The  two  dimensional  MRTD  is  FLIR92’s  final  output.  This  spatial  frequency 
dependent  MRTD  function  can,  for  example,  be  inserted  into  other  electro-optic  decision 
aids  such  as  EOTDA,  or  NVESD  ACQUIRE  [Ref.  16]  to  develop  range  predictions  for 
proposed  systems.  The  same  information  is  provided  for  MDTD.  FLIR92  was  run  for  the 
systems  used  in  the  lab  experiments,  and  the  results  were  plotted.  The  plots  of  the  data  are 
included  as  Figs.  C.  1  and  C.2.  These  results  are  compared  to  VISMODII  predictions  and 
measured  laboratory  results  in  Chapter  VI. 
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MRTD  (degrees  C) 


0.03 


FUR92  Predictive  MRTD,  Amber  System 


FigureC.l.  FLIR92  predicted  MRTD  for  Amber  system 


39 


FLIR92  Predictive  MRTD,  Mitsubishi  System 


Figure  C.2.  FLIR92  predicted  MRTD  for  Mitsubishi  system 
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APPENDIX  D.  LABORATORY  MEASUREMENT  RESULTS 
This  appendix  contains  the  tabulated  results  for  the  laboratory  measurements  made. 
Tables  D.l  and  D.2  contain  the  results  for  the  AMBER  system.  Figures  D.l  and  D.2  are 
the  plots  of  the  tabulated  data.  The  average  and  two  dimensional  MRTD  plots  are 
contained  in  Chapter  FV. 

TABLE  D.l.  Amber  system  measured  horizontal  MRTD 


Spatial  fr eq 
(cy/mrad) 

Trial  1 
(degrees  C) 

Trial  2 
(degrees  C) 

Average 
(degrees  C) 

.10 

.33 

.28 

.31 

.15 

.33 

.31 

.32 

.20 

.33 

.17 

.25 

.25 

.28 

.39 

.33 

.30 

.36 

.31 

.33 

.375 

.33 

.44 

.39 

.40 

.39 

.28 

.33 

.50 

.33 

.28 

.31 

.60 

.44 

.44 

.44 

.625 

.42 

.33 

.38 

.70 

.56 

.56 

.56 

.75 

.61 

.61 

.61 

.80 

.58 

^  .75 

.67 

.875 

.67 

.83 

.75 

1.0 

.78 

1.6 

1.17 

1.2 

1.5 

2.6 

2.01 
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TABLE  D.2.  Amber  system  measured  vertical  MRTD 


Spatial  freq 
(cy/mrad) 

Trial  1 
(degrees  C) 

Trial  2 
(degrees  C) 

Average 
(degrees  C) 

.10 

.33 

.28 

.31 

.15 

.33 

.31 

.32 

.20 

.33 

.17 

.25 

.25 

.28 

.39 

.33 

.30 

.36 

.31 

.33 

.375 

.39 

.39 

.39 

.40 

.44 

.44 

.44 

.50 

.19 

.56 

.38 

.60 

.25 

.64 

.44 

.625 

.42 

.61 

.51 

.70 

.56 

.81 

.68 

.75 

1.1 

.89 

1.0 

.80 

1.1 

.83 

.94 

.875 

1.6 

1.0 

1.3 

1.0 

1.6 

1.1 

1.4 

1.2 

3.3 

3.3 

r . . 

3.3 
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Tables  D.3  and  D.4  contain  the  measurement  results  for  the  Mitsubishi  system.  This 
data  is  plotted  in  Figs.  D.3  and  D.4.  The  average  and  two  dimensional  plots  are  contained 
in  Chapter  IV. 


TABLE  D3.  Mitsubishi  system  measured  horizontal  MRTD 


Spatial  £req 
(cy/mrad) 

Trial  1 
(degrees  C) 

Trial  2 
(degrees  C) 

Average 
(degrees  C) 

.10 

.08 

.06 

.07 

.15 

.08 

.06 

.07 

.20 

.12 

.18 

.15 

.25 

.15 

.13 

.14 

.30 

.28 

.11 

.19 

.375 

.26 

.13 

.19 

.40 

.28 

.14 

.21 

.50 

.26 

.13 

.19 

.60 

.28 

.19 

.24 

.625 

.31 

.19 

.25 

.70 

.36 

.31 

1  .33 

.75 

.28 

.25 

.26 

.80 

.36 

.36 

.36 

.875 

.31 

.31 

.31 

1.0 

.44 

.33 

.39 

1.2 

.78 

.78 

.78 
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TABLE  D.4.  Mitsubishi  system  measured  vertical  MRTD 


Spatial  fireq 
(cy/mrad) 

Trial  1 
(degrees  C) 

Trial  2 
(degrees  C) 

Average 
(degrees  C) 

.10 

.08 

.06 

.07 

.15 

.08 

.06 

.07 

.20 

.17 

.11 

.14 

.25 

.22 

.11 

.17 

.30 

.25 

.11 

.18 

.375 

.22 

.14 

.18 

.40 

.39 

.11 

.25 

.50 

.39 

.19 

.29 

.60 

.44 

.31 

.38 

.625 

.44 

.47 

.46 

.70 

.81 

.44 

.63 

.75 

.83 

.75 

.79 

.80 

1.1 

.70 

.90 

.875 

1.3 

.69 

1.3 

1.0 

1.2 

** 

♦  9|C 

beyond  spatial  resolution  of  system,  no  MRTD  possible. 


Tables  D.5,  D.6,  and  D.7  contain  the  data  obtained  in  the  ‘objective’  MRTD 
measurements.  This  data  is  plotted  in  Chapter  IV,  and  discussed  in  Chapter  V. 


TABLE  D.5.  Constant  SNR  =  6.0 


TABLE  D.6.  Constant  delta  T  =  3.5  Cdsius 
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TABLE  D.7.  Constant  spatial  frequency  =  0^  cy/mrad 


SNR 

delta  T 

1 

0.8 

2 

1.5 

3 

1.8 

4 

2.35 

5 

3.0 

6 

3.7 

7 

4.2 

8 

5.0 
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APPENDIX  E.  MATLAB  CODE 


An  example  of  the  MATLAB  script  files  that  produced  the  VISMODII  prediction 
curves  are  contained  in  this  appendix.  There  are  three  files.  The  first,‘v2’,  is  the  shell 
program  that  contains  the  TIS  information  and  the  preliminary  calculations.  It  the 
second  program,  ‘effcnt’,  to  calculate  the  contrast  transference  parameter.  The  ‘effcnt’ 
program  calls  ‘alias’  to  calculate  the  aliasing  and  sample  scene  phase  terms.  Control  is  then 
handed  back  to  ‘v2’,  which  calculates  the  ATjc  tenn.  V2  also  calculates  and  plots  the 
MRTD  curves. 

A.  V2.M 


%%%%%%%%%%%%%%%%%%%%%%%% 


%  Mike  Groen 

%  11/01/95 

%  VISMODH  MITSUBISHI 


%  Given  system  parameters,  this  script  file  will  predict 

%  MRTD  curve  for  staring  airays 

%  requires:  effcntm,  alias.m,formmtf.m/econmtf.m,plotmtf.m 

% 


%%%<i 


clear; 

clg; 

%%%%%  Define  spatial  frequencies  of  interest  (cy/mrad) 
fbar=[.05:.05:1.2]; 

%fbar=.6 

%%%%%%%%%%%%%%%  System  Parameters 
%%%%%%%%%%%%%%%%%%%%%%% 


nh=5 12;  %  number  of  horizontal  detector  elements 

nv=5 12;  %  number  of  votical  detector  elements 

a=16.24;  %  detector  active  horizonal  dimension  (um) 

b=12.49;  %  detector  active  vertical  dimension  (um) 

hpitch  =  26;  %  detector  pitch,  horizontal  (um) 

vpitch  =  20;  %  detector  pitch,  vertical(  um) 

fnumber  =1.4;  %  system  f-number 
focal  =  50;  %  focal  length  (mm) 

Fdot=60;  %  frame  rate  (Hz) 

clock  =  .97;  %  clock-out  factor  (determines  integration  time) 
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Dstaip=5elO;  %  peak  D-star  (cm-Hz'' 1/2/Watt) 
lambdq)=5.0;  %  peak  wavelength  (um) 
lambdal=3.0;  %  wavelength  1  (um) 

lamb<ia2=5.0;  %  wavelength  2  (um) 

fxec=2.3e6;  %  electronic  cut  off  (Hz) 

monfac=.25;  %  monitor  gaussian  rms  factor  normalized  by  alpha 
poles=  1;  %  number  of  poles  for  electronic  filter 

blurspot  =  0;  %  standard  deviation  of  blur  spot  diameter  (mrad) 

theh  =0;  %  average  angle  off  array  center  image  is  (rad) 

thev  =  0;  %  ditto,  vertical  (rad)  [usually  zero  or  .785] 

lloydc2  =  1.4388e4; 

Tbg  =  300; 

To  =  >5; 
delTsc  =  0; 
sigmavh  =  .4; 

SNRthr  =  6.0; 
te  =  .2; 

% 

%  preliminaries 

% 

avglambda=0.5*(lambdal+lambda2);%  ave  lambda 

opdia  =  focal/fnumber;%  optical  diameter(mm) 

alpha=hpitch/focal;  %  alpha  in  mrad 

beta=vpitch/focal;  %  beta  in  mrad 

ao=pi*(opdia/2)''2;  %  area  of  collecting  lens  (mm'^  2) 

td=clock/Fdot;  %  compute  dwell  time  (sec) 

fopt=opdia/avglambda;%  optical  cut  off  in  cy/mr 

fsh  =  focal/hpitch;%  horizontal  sampling  frequency  (cy/mr) 

fsv  =  focal/vpitch;%  vert  samp  freq  (cy/mr) 

tclock=nh*nv*Fdot; 

fth=alpha*tclock; 

ftv=beta*tclock/nh; 

fehos  =  fxec*focal/(Fdot*nh*hpitch);%  out  of  clock  direction,  elec  cutoff 
%  in  (cy/mrad) 

fevis  =  fiiec*focal/(Fdot*nh*nv*vpitch);%  in  clock  out  direction  (cy/mrad) 

%sspmaxh  =  hpitch/2; 

sspmaxh=0; 

%sspmaxv  =  vpitch/2;%  max  sample  scene  phase  error 
sspmaxv=0; 

%%%%%%%%%%%%%%  Calculate  contrast  function 
%%%%%%%%%%%%%%%%%%% 


[ctf,vctf,delf,alias]  = 

meffcnt(fbar,fsh,fsv^opt,alpha,beta,blurspot,theh,thev,fehos4evis,poles4nonfac,sspmaxh, 

sspmaxv); 

%  plot  contrast  transfer  function 

plot(fbar,ctf) 

axis([02  01]) 

xlabel(‘Spatial  Frequency  (cy/mrad)’) 
ylabel(‘CTF’) 

title(‘Contrast  Transfer  Function,  horizontal  MRTD’) 

%keyboard 
plot(fbar,vctf) 
axis([02  01]) 

xlabel(‘Spatial  Frequency  (cy/mrad)’) 
ylabel(‘CTF’) 

title(‘Contrast  Transfer  Function,  vertical  MRTD’) 

%keyboard 

%%%%%%%%%%%%%%%%  Find  system  delta  T  critical 

%%%%%%%%%%%%%%%% 

if  delTsc  >0  %  that  is,  it’s  given 

delTsc  =  delTsc; 

else  %  calculate  delTsc 
%  NETD  part  first 

refbw  =  (pi/4)*(l/td); 

nl  =  pi*sqrt(a*le-4*b*le-4*rcfbw); 

dl  =  (alpha*beta*le-6*To*ao*le-2*Dstaip); 

d2  =  lloydc2/(lambdap*Tbg''2)*(quiid2var(‘sre’,  lambdal,  lambda2, 

Tbg)); 

NETD  =  nl/(dl*d2) 

%  SNR  improvements 

tn2  =  (l+sigmavh''2)*pi'^2*SNRthr/(8*sqrt(te*Fdot)); 

%  bandwidth  correction 


% 

MTFsys  =  abs(MTFrf); 

% 

totbw  =  sum(MTFsys)*delf*tclock; 

% 

bwcorr  =  sqrt(totbw/refbw); 

%  new  delTsc 

% 

delTsc  =  tn2*NETD*bwcorr; 

end 

delTsc=.07; 

%%%%%%%%%%%%%%%%  Find  system  MRTD 
%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
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MRTDH  =  delTsc./ctf;MRTDV  =  delTsc./vctf; 
plot(fbarJVIRTDH,  ‘co’) 
axis([0  1.6  0  3]) 

xlabel( ‘Spatial  Frequency  (cy/mrad)’) 
ylabel(‘MRTD’) 

titie(‘Mitsubishi  system  MRTD,  nnyn’) 

%keyboard 
hold  on 

plot(fbar>IRTDV,  ‘y*’) 
axis([0  1.2  0  1.4]) 

%xlabel(‘ Spatial  Frequency  (cy/mrad)’) 

%ylabel(‘MRTD’) 

%tiUe(‘Vertical  MRTD’) 

%%%%%%^  >,%%%%%%%  2D  MRTD  %%%%%%%%%%%%%%%%%%%%%% 

MRTD2D  =  (MRTDH+MRTDV)./2; 

plot(fbar,  MRTD2D,  ‘g+’) 

legend(‘Horizontal’,  ‘Vertical’, ’2D  MRTD’) 

plot(fbar4^TDH,  ‘c’) 

plot(fbar J^TDV,  ‘y’) 

plot(fbar,  MRTD2D,  ‘g’) 

grid 

save  mhz2nnyn 

%print 

%exit 

B.  EFFCNT.M 

%  Mike  Groen 

% 

%  This  script  creates  a  standard  four  bar  pattern  of  freq 

%  specified  by  the  user.  It  then  passes  it  through  a  simulated 

%  TIS  ( as  represented  by  an  MTF  and  aliasing),  and  produces  the 

%  reconstructed  pattern  at  the  ouqjut. 

%  Loops  through  the  range  of  spatial  ffeq’s  desired,  and 

%  calculates  the  contrast  function 

function  [contrast, vercon,MTFrf,delf,ACF  ]  =  meffcnt(fbar,fsh4sv,fopt,alpha,beta, 
blurspot,  theh,  thev,fxec,poles4nonfac,fth,ftv,sspmaxh,sspmaxv); 

%clear;fbar=.6;fsh=2;fsv=2;fopt=3.4;alpha=.25;beta=.55;blurspot=0;theh=0.785;thev=0. 

785; 

d=size(fbar);d2=d(2); 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

%  create  bar  pattern 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
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coll  =zeros(130,10); 

col2  =  [zeros(30,10);ones(70,10);zeros(30,10)]; 
col3  =  zeros(130,93); 
row!  =  zeros(63,256); 

A=[rowl  ;col3,col2, coll  ,col2, col  l,col2,col  1  ,col2,col3;rowl]; 

V=A’; 

%%%%%  transform  A  into  spatial  freq  domain 

B=fft2(A);w=frt2(V); 

b=abs(B);x=abs(w); 

%%%%%%%%%  now  loop  through  frequencies 

for  counter  =  l:d2; 

ftc=fbar(counter); 

%  W  refers  to  the  actual  width  of  one  bar  in  mrad 

%  the  ‘del’  terms  are  used  to  find  the  a{^rq)riate  frequency  and 

%  space  scales 

W=l/(2*fx); 

Nw  =  10;  %  number  of  elements  in  one  bar(x) 

Nt  =  256;  %  munber  of  elements  in  vector(m  x  m) 

delt  =  W/Nw; 

DELt  =  Nt*W/Nw; 
delf  =  1/DELt; 

DELf=  1/delt; 
finax  =  DELf/2; 

fscale  =  linspace(-fmax^ax,256); 
xscale  =  lin^ace(-DEL4/2,DELt/2,256); 
yscale  =  linspace(-DELt/2,DELt/2,256); 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
%%%%%%  create  image  formation  MTF 
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
umatrix=G; 

ux=linspace(.01  ,fmax,  128); 
uy=ux’; 

%  make  2D  xfer  fen 
for  covmt  =1:128; 

gaussu  =  sqrt(ux(count)'^2.+uyA2); 
umatrix  =  [umatrix,  gaussu]; 
end 

%  DIFFRACTION  LIMITED  OPTICAL  MTF.  (diffractitm  limited,circular  aperture) 
cl=umatrix  ./fopt; 
c2=sqrt(l-cl  A2); 
ro=2/pi  .*(acos(cl)-(cl  .*c2)); 

%  GEOMETRIC  BLUR  OPTICAL  MTF 
fl  =  (umatrixA2).*pi^2.*(-2).*blurspot'^2; 
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rb  =exp(fl); 

%  HORIZONTAL  AND  VERTICAL  SAMPLE  SCENE  PHASE  MTF 
rsh  =  (2*umatrix(:,l)/fsh)*theh; 
rsh2  =  cos  (rsh); 

rsv  =  (2*umatrix(l,:)/fsv)*thev; 
rsv2  =  cos  (rsv); 
rs  =  rsh2*rsv2; 

%  DETECTOR  HORIZONTAL  MTF.  (for  rectangular  detector) 
c3=pi  .*alpha  .*umatrix(l,:); 
rdh=abs(sin(c3) ./  c3) ; 

%  DET  iCTOR  VERTICAL  MTF.  (for  rectangular  detector) 
dv  =pi  .*beta  .*uniatrix(:,l); 
rdv=abs(sin(dv) ./  dv) ; 

%  DETECTOR  2D  MTF 

rd=rdv*rdh; 

MTFif  =  ro(l,:).*rd(l,:).*rb(l,:).*rs(l,;): 

u=ro.*rd.*rb.*rs; 

%  get  mtf  in  appropriate  matrix  configuration 

mtfif  =  [u^plr(u)]; 

mtfif2  =  [mtfif ;flipud(mtfif)]; 

mtfif  =  fftshift(mtfif2); 

%%%%%%%  multiply  image  spectrum  times  image  formation  MTFl 
d=fftshift(B);d2  =  fftshift(w); 
mess  =  d.*mtfif;mes2  =  d2.*mtfif; 

%  aliasing  stuff  starts  here 

aliasterm  =  zeros(size(mess)); 
valiasterm  =  aliasterm; 

disp(‘Calculating  aliasterm  for:’);fbar(counter) 
aliasterm  =  alias(fscale,fsh/sv4ness,sspmaxh,sspmaxv); 
valiasterm  =  alias(fscale,  fsh,fsv,mes2,sspmaxh,sspmaxv); 

%%  add  alias  term  to  filtered  scene 

withalias=  mess  +  aliasterm; 
vertalias  =  mes2  +  valiasterm; 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

%%  Now,  create  the  image  reconstruction  filter 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
clear  u  ux  uy  K  gaussu 
umatrix  =  Q; 

ux=linspace(.01  ,fmax,  128); 
uy=ux’; 

%  make  2D  gaussian  symmetric  xfer  fen 
for  coimt  =1:128; 

gaussu  =  sqrt(ux(count)^2.+uy.''2); 
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umatrix  =  [umatrix,  gaussu]; 
end 

%  ELECTRONICS  MTF.  (multi-pole  low  pass  filter) 
tfreqh=umatrix*fth; 
c6=(ufflatrix  ./&cec)  .'K2*poles); 
re=l  ./(sqrt(l-i-c6)); 

%  ELECTRONICS  PTF 

eptf  =  -atan(umatrix./6(:ec); 
ptf  =  exp(j*eptf); 

%  CRT  MONITOR  SPATIAL  MTF. 
c7=(xmiatrix  y(  1/alpha))  .'^2; 
c8=(monfac)  %  sigma/alpha  =  .25 

rm=exp(-2  *pi'^2  .*c7  .*c8); 

MTFrf  =  (re(l,:).'^2).*(rm(l,:).A2); 
u=re.*nn.*ptf; 

%  get  mtf  in  appropriate  matrix  configuration 

mtf2  =  [u^plr(u)]; 

mtf2a  =  [mtf2;flipud(mtf2)]; 

mtf2b  =:  f¥tshift(mtf2a); 

%%%%  multiply  image  reconstruction  times  the  aliased,  filtered,  scene 

outalias  =  withalias.*mtf2b: 

noalias  =  mess.*mtf2b; 

veral2  =  vertalias.*mtf2b; 

veralS  =  mes2.*mtf2b; 

%%%%%%%%%%%%%7o%%%%%%%%%%%%%%%%%%% 

%%%%%%%%  transform  back  to  spatial  domain 
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
messy  =  fiitshift(outalias);messy2  =  fftshift(noalias); 
gigo  =  fftshift(veral2);gigo2  =  fftshiftCvwalS); 
C=ifft2(messy);D=ifft2(messy2);E=iffi2(gigo);F=ifft2(gigo2); 
C=abs(C);D=abs(D);E=abs(E);F=abs(F); 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

%% 

%%%%%%%%  calculate  aliasing  contrast  reduction 


% 

aliasnoise  =  C-D;vertnois  =  E-F; 

ver  =  aliasnoise(93: 163,93: 163);aver  =  vertnois(93: 163,93: 163); 

ACF(counter)  =  mean(mean(ver));ACF2(counter)  =  mean(mean(ver)); 
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
%%%%%  Find  the  output  contrast  value 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
newbar  =  [0(93:163,98:99)]; 
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verbar  =  [F(98;99,93:163)]; 

m=size(newbar);nu=m(  1  )*m(2); 

high  =  sum(sum(newbar))/nu; 

verhigh  =  sum(sum(verbar))/nu; 

newspace  =  [0(93:163,108:109)]; 

verspace  =  [F(108: 109,93:163)]; 

n=size(newspace)  ;im=n(  1 )  *n(2); 

low  =  sum(suni(newspace))/nn; 

verlow  =  sum(sum(verspace))/im; 

contrast(cx)unter)  =high  -  low  -  ACF(counter); 

vercon(counter)  =  verhigh-verlow-ACF2(counter); 

if  contrast(counter)  <  0; 

contrast(counter)=contrast(counter-l)/10; 

end 

if  vercon(counter)  <  0; 

vercon(counter)  =  vercon(coimter-l)/10; 

end;end 


C.  ALIAS.M 


% 


Mike  Groen 


% 

%  This  is  the  aliasing  portion  of  effcnt.m 

function  [aliasterm]  =  alias(fscale,fsh,fsv,mess,b,c) 
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
%%%%%  represent  aliasing  by  repeating  the  filtered  spectrum  at 
%%%%%  sampling  freq  intervals 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

alias  tx=zeros(256,256); 

aliasty=aliastx; 

where  =  find(fscale/fsh  >1); 

if  where  =  Q; 

cent  =  256;multiple  =  0; 

else 


cent  =  where(l);multiple  =  1; 

end 

start=cent-128;unused  =  256-start; 
aliastx(:,start:256)  =  mess(;,l:imused+l); 
alias  tx=aliastx.*exp(j*2*pi*b*fsh); 
aJiash  =  fliplr(aliastx); 
aliasx  =  aliastx+aliash; 
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wherev  =  find(fscal^fsv  >1); 
if  wherev  =  D; 

centv  =  256;multiplev  =  0; 

else 


centv  =  wherev(l);multiplev  =  1; 
end 

startv=centv-128;unusedv  =  256-startv; 
aliasty(startv:256,:)  =  mess(l:unusedv+l,:); 
aliasty=aliasty .  *exp(j  *2*pi*c*fev); 
aliasud  =  £lipud(aliasty); 
aliasy  =  aliasty+aliasud; 

%%%  alias  cross  terms 

aliasyx(startv:256,:)  =  aliasx(l:unusedv+l,:); 

aliasyxud  =  flipud(aliasyx); 

aliasyx  =  aliasyx+aliasyxud; 

aliasxy(:,start:256)  =  aliasy(:,start:256); 

aliasxylr  =  fliplr(aliasxy); 

aliasxy  =  aliasxy  +  aliasxylr; 

crossterm  =  multiple*multiplev*(aliasxy+aliasyx); 

aliastenn  =  muldple^aliasx  +  multiplev*aliasy  +a‘ossterm; 
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